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Fluctuations of global additive quantities, like total energy or magnetization for instance, 
fvj ■ can in principle be described by statistics of sums of (possibly correlated) random vari- 

^ ' ables. Yet, it turns out that extreme values (the largest value among a set of random 

Q\ ' variables) may also play a role in the statistics of global quantities, in a direct or indirect 

^+ , way. This review discusses diff'erent connections that may appear between problems of 

\1^ ■ sums and of extreme values of random variables, and emphasizes physical situations in 

which such connections are relevant. Along this line of thought, standard convergence 
theorems for sums and extreme values of independent and identically distributed ran- 
dom variables are recalled, and some rigorous results as well as more heuristic reasonings 
are presented for correlated or non-identically distributed random variables. More specifi- 
cally, the role of extreme values within sums of broadly distributed variables is addressed, 
and a general mapping between extreme values and sums is presented, allowing us to 
identify a class of correlated random variables whose sum follows (generalized) extreme 
value distributions. Possible applications of this specific class of random variables are 
J^ ' illustrated on the example of two simple physical models. A few extensions to other 

$_( ' related classes of random variables sharing similar qualitative properties are also briefly 

C^ discussed, in connection with the so-called BHP distribution. 

Keywords: Non-Gaussian fluctuations; Extreme value statistics; Correlated systems; Cen- 
tral limit theorem. 



1. Introduction 

The present review deals with the issue of fluctuations of global quantities and the 
possible relevance of extreme values in the statistics of these fluctuations. A physical 
quantity is called a global quantity, or global observable, when it is defined as the 
spatial sum of local quantities in a large enough system (or subsystem). For instance, 
the total energy and the total magnetization of a macroscopic system are global 
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observables. Such quantities are very frequent in physics since on the one hand 
they are useful characterizations of macroscopic systems, and on the other hand 
most measurement apparatus have a resolution that is much larger than the scale 
of individual degrees of freedom. Hence from a practical viewpoint, most measured 
quantities turn out to be sums of local quantities, and thus fall into the category of 
global observables. 

When measuring a global observable, one usually records a time signal, and the 
first quantity that can be determined from this signal is the mean value, which is a 
natural characterization of the system (assuming the system to be in a stationary 
state; extension to slow time evolution may also be considered). Then, to go beyond 
mean values, it is interesting to quantify fluctuations around the mean, for instance 
by determining the empirical variance of the signal. A more refined information is 
given by the full probability distribution of the fluctuations. Such a distribution is 
of particular interest since it may give information on the physics of the system. The 
main reason for this is the existence of the Central Limit Theorem (CLT), which 
states that a sum of a large number of independent and identically distributed (i.i.d.) 
random variables is distributed according to a Gaussian (or normal) distribution, 
provided that the second moment of each individual variable is finite -a more precise 
statement of the theorem will be given below. 

The CLT, as any other theorem, relies on some assumptions that are of course not 
always true in physical systems. In particular, the second moment of the individual 
variables may not be finite, in which case other different asymptotic distributions 
(the so-called Levy-stable laws) are reached in the limit of an infinite number of 
terms. This may hap pen in different physical con texts, like glass es and d isordered 
systemsj I I I I I I I laser cooling experiments,'^'^ turbulent flowsj I ' 'or blink- 
ing of nanocrystals,'^ to quote only a few of them. Qualitatively, the departure 
from the Gaussian distribution is in this case due to the fact that a few terms be- 
come extremely large and dominate the sum. In contrast, when the second moment 
is finite, all terms within the sum are of the same order, and none of them play a 
dominant role. 

Another situation of physical relevance, for which Gaussian distributions may 
not be found (even in the limit of an infinite number of terms), is when the variables 
that arc summed are correlated. Intuitively, one may expect that the Gaussian 
distribution still holds when the correlations are "weak" , so that "strong" enough 
correlations may be necessary to prevent the distribution of the sum from converging 
to the Gaussian law. On the mathematical side, one must admit that a rigorous 
generic approach to this problem is a really difficult task and, to the best of our 
knowledge, no general results or criteria seem to be available. Hence correlated 
variables can only be treated case by case, leading to a (probably still incomplete) 
gallery of various limit distributions. 

From a physicist viewpoint, a qualitative understanding of systems involving 
sums of correlated variables may be gained in some cases from simple scaling argu- 
ments, allowing one to guess whether the CLT (or an extension to it) is expected 
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to hold or not. The simplest of these arguments is an estimate of the number 
of "effectively independent" random variables. When this number diverges with 
the total number of terms in the sum, it is reasonable (at least to the physi- 
cist's mind) to consider that the limit distribution should be Gaussian (if the 
second moment is finite). Still, a significant number of physical systems do not 
fulfill this condition, and fluctuations of global observables then display a non- 
Gaussian statistics, even in the infinite size limit. Indeed, a vast number of different 
non-Gaussian dist ribution s have been reported in different cont exts, like critical 
phenomena, -'^^ ili~z!~width distribution of growing inte rfaces p^p^p ^ l ^^ l ^'^ l ^^ l 
turbulent flows p^ ' ^^ l ^^ l ^^ p^ driven nonequilibrium systems,'2Q'^l'S2133lor different 
types of quantum systemsj ^ ^ ^ to give only a few examples. It is interesting to 
note that among these non-Gaussian distributions, asymmetric distributions rather 
similar to those appearing in the context of extreme value statistics (the statistics 
of the maximum or minimum value in a set of random variables) have been repeat- 
edly found.37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 i^ is thus natural to wonder 

whether this is a mere coincidence, or if there may be some generic reasons for such 
a similarity. 

Altogether it turns out that, in a rather unexpected way, extreme values seems 
to play a role in the statistics of random sums, both for sums of broadly distributed 
random variables and for sums of correlated or non-identically distributed variables. 
The analysis of these two problems actually reveals that the role of extreme values 
is very different in both cases. Specifically, in the case of correlated variables, the 
similarity with extreme value statistics does not come from a dominant contribu- 
tion of the largest terms, but rather from a natural, though not obvious, mapping 
between extreme values and sums of random variables. 

Having this intricate picture in mind, we believed it would be relevant to treat es- 
sentially on the same footing the statistics of sums and of extreme values of random 
variables, before dealing with the different relationships arising between these fields. 
Accordingly, the paper is organized as follows. Some elementary statistical concepts 
are briefly recalled in Sect. 2. Standard mathematical theorems concerning the con- 
vergence to asymptotic distributions of both random sums and extreme values are 
presented in Sect. 3, in the case of independent and identically distributed variables. 
The case of dependent and of non-identically distributed variables is addressed in 
Sect. 4, paying particular attention to physical arguments and examples. 

Let us emphasize that giving an exhaustive review of such a large topic as sums 
and extreme values of random variables, is obviously far beyond the scope of the 
present review paper. Accordingly, the latter has the more modest aim of giving 
the reader an overall (though incomplete) picture, from a physicist perspective, of 
the basic results and issues in these fields, with specific emphasis on some recent 
results providing unexpected connections between them. In this spirit, we tried to 
make mathematical statements as precise as possible, while also leaving room for 
numerous physical discussions and examples. 
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2. Some probabilistic concepts useful in physics 

2.1. Random variables: dependence, joint probability and spatial 
organization 

One of the main goals of statistical physics is to study the macroscopic properties of 
models defined by some microscopic interaction rules between " particles" , or more 
generally, microscopic degrees of freedom. The paradigm behind this approach is the 
belief that there exists, at least for some classes of systems, general mechanisms for 
going from the microscopic rules to a macroscopic behavior, so that the knowledge 
gained from the study of specific models goes beyond a collection of particular 
results. In this section, we would like to go from the physicist's viewpoint to the 
mathematician's one: this will be useful in the rest of the present article, and might 
also illustrate the way mathematics and physics interact in statistical mechanics. 

Let us start by one of the archetypal model of statistical physics, namely the Ising 
model. On each site i — 1, . . . , TV of a D-dimensional square lattice|fj a spin variable 
can take two possible values Si — ±1. Each spin Si interacts with its nearest neighbor 
and with an external magnetic field h, so that the total energy of a configuration 
s = {si}i^i,,,N is given by the celebrated Hamiltonian: 

N 

H[s]= -K'^SiSj -h^Si, s = {si}i^i,,,N- (1) 

(ij) i=l 

The summation in the first term is over all pairs of nearest neighbor sites i and j. 
A global observable a statistical physicist may be interested in is the magnetization 
m[s] of a given configuration: 



1 ^ 

In the canonical ensemble, the average of this quantity at a given inverse tempera- 
ture f3 — l/fcsT, is defined by 

(m) = Yl ^ W"! W , P[s] = ^e-^^ W . (3) 

s 

The normalization constant Z is the canonical partition function of the model. 
The function P[s] is then the probability of a given configuration s. Most often, 
it is not an easy task to explicitly compute the mean magnetization. The problem 
comes from the nearest neighbor interaction, which induces statistical correlations 
between sites i and j. Spins are independent only in the specific case K — 0, when 
no interactions are present. In this case one easily obtains {m) = tanh(j3h). 

The above physical example could be rephrased in a more mathematical lan- 
guage. In probabilistic terms, a spin configuration s forms a set of random variables 



''Throughout the article, we generically denote as TV the number of random variables considered. 
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(si, . . . , sjv), and the probability P[s] of a configuration is denoted as the joint prob- 
ability JAr(si, . . . , sn) of the random set. The random set is fully characterized by 
its joint probability, which is the probability to obtain the particular set (si, . . . , s^) 
from a realization of the random variables. From this joint probability one can de- 
fine the marginal probability density Pi{si) associated to the random variable s^, by 
summing Jn{si, . . . , sjv) over all the remaining variables: 

Pi{si) ^ ^ Jjv(si, ...,Si-_i,Sj,Sj+i, ...,sjv)- (4) 

The N random variables Si are independent if and only if the joint probability can 
be factorized as the product of the marginal distributions Pi{si), 

N 

JAr(si,...,SAr) = ]^Pi(Si). (5) 

i=l 

In the Ising model, and more generally in canonical equilibrium systems, there is 
an obvious link between the joint probability and the Hamiltonian: 

Jn{si,...,sn) = — exp[-/5H(si,...,SAr)] , (6) 

and the non-interacting case {K = 0) corresponds to independent variables in the 
probabilistic view: 

1 ^ 
J^{su-,SN) = -l[e-^'^^'. (7) 

This elementary example shows how problems of statistical physics can be recast 
into a probabilistic language. Let us point out that in physics, in contrast to what 
happe ns in mathematics, a meaning is given to the random quantities, and to their 
labels.l^ It introduces some key concepts from the physicist's viewpoint such as a 
distance (spatial or temporal) and a space dimensionality. This is the reason why the 
description of the dependence of random variables in terms of the joint probability 
is somehow too rich for the physicist, who often prefers a simpler characterization 
through the two-point correlation function: 

Cij = {s,Sj) - {s,){sj), (8) 

which emphasizes the spatial structure of the model. Under the assumption of ho- 
mogeneity and isotropy, an even more 'compact' information can be obtained from 
a correlation length or time, defined as the characteristic scale of the correlation 
function ^, 

C^, - Co/ (^^) , (9) 

where / is a dimensionless function and Tij is the euclidean distance between sites i 
and j. Quite often, a lot of information on a physical system can be gained from the 
behavior of the correlation length with temperature, magnetic field or other control 
parameters. 
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2.2. Concept of asymptotic distributions 

As already pointed out, the specificity of physics (and of other sciences aiming at 
describing real systems in a mathematical language) is to give an interpretation, 
in connection with the real world, to the mathematical objects involved in the 
proposed description. From the physicist's point of view, probability theory provides 
various theorems that are kinds of "reasoning shortcuts" , ready to be used in a given 
physical context. Among the most useful theorems are the convergence theorems, 
which will be presented in Sect. [31 In the present section, we recall elementary 
definitions and probabilistic tools. Our aim is not to present in a rigourous way 
probability concepts but to introduce practical tools that are needed in the following 
sections. 

We already considered discrete random variables, like spin variables s, in the 
previous section. Discrete random variables are most often characterized by the 
probability P[s\ of each configuration s. In contrast, when considering continuous 
random variables, several probabilitic tools may be used depending on the context. 
From the physicist's point of view, a continous random variableo X is character- 
ized by a non- negative function p(a;), the probability density function (PDF), or 
probability distribution, of X. This PDF is such that the cumulative probability 
distribution F{x) can be expressed as 

Prob(X <x) = F{x) = / dx' p{x'). (10) 



The random variable X can equivalently be described by its characteristic function 
x(a;), defined as the Fourier transform oi p{x): 

x{^) = da; p{x)e' 



Two random variables have the same characteristic function if and only if they have 
the same PDF. Since the PDF of the sum of two independent random variables xi 
and X2 is the convolution product pi *p2 of their PDF, the characteristic function 
of the sum is the product xiX2 of the characteristic functio ns of xi and X2- This 
property makes the characteristic function a very useful tool. 

Once these mathematical objects are defined, let us ask the following question. 
Consider a sequence of N random variables {xk}k=i---N, distributed according to 
a joint probability distribution Jn{xi, . . . , xn). Let us then define another random 
variable, say yjsf = 4>{xi, . . . , xn), where is a given arbitrary function. The question 
we ask is whether it is possible to find a sequence of numbers {{aN^b^ > 0)} such 
that the distribution function of the random variable zjv = {vn — o.N)/bN converges 
toward a PDF poo(z), where Poo{z) is a proper PDF (not concentrated at one 
point) when N goes to infinity. In such case, Pooiz) is called the asymptotic, or 



''In the rest of the paper, we shall most of the time use the same notation for a random variable 
X and its value x. 
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limit, distribution of z, and by extension of y. The joint probability distribution 
Jn^xi, . . . ,xn) is said to belong to the domain of attraction I?(poo) of Poc- In 
the case of i.i.d. random variables, for which the joint distribution factorizes as 
JnIxi, ■ ■ ■ ,xn) = Y[i=iPi^i)j one says that the marginal distribution p{x) belongs 
to the domain of attraction 'D{poo)- 

For a generic function 0(xi, . . . ,xjv), it is extremely difficult to identify the 
asymptotic distribution (when it exists) and the corresponding domain of attraction. 
However, two particular examples hav e been extensiv ely studied by mathematicians: 
the case of sums of random variablesj "^ l ^" ! '-'" ! '-'' ! ^" ! (t>{xi, ■ ■ ■ , Xn) = yZi=i Xj, a nd 
the case of extreme values, 4>{xi, • • • , xn) = max(a;i, . . . , xjv)! ^ ^ ^ ^ ^ ^ As 
already pointed out in the introduction, we shall focus in this article on these two 
specific cases, and see that under additional assumptions, mathematics provides 
some very interesting results. 

As a side remark, let us note that words like "domain of attraction" and "limit 
function" might ring a bell to the physicist: it is indeed reminiscent of the renormal- 
ization group language. This is actually not a mere coincidence, as pointed out for 
instance by Jona-Lasinio. One can actually see the renormalization group proce- 
dure as a way to compute limit distributions in physical situations where standard 
mathematical results may not be applicable. We shall come back to this point in 
Sect. 14X51 

3. Asymptotic distributions of sums and extremes of i.i.d. random 
variables 

3.1. Statistics of random sums and Gaussian distribution 

3.1.1. Standard Central Limit Theorem for i.i.d. random variables 

Let us consider a set of random variables {a;i}i=i_...^jv, and let us denote their sum, 
which is also a random variable, as ijn' 

N 
IJN ^ 4>{xi,- ■ ■ ,Xn) ^^Xi. (11) 

i=l 

This new random variable could a priori be described by an arbitrary PDF. How- 
ever, it turns out that the Gaussian (or normal) distribution appears in such a large 
collection of phenomena that it has been somehow considered as "universal" . This 
belief led Henry Poincare to his famous comment P^ "All the world believes it firmly, 
since mathematicians imagine that it is a fact of observation and the observers that 
it is a mathematical theorem.^^ In this section we summarize the main standard 
theorems, and comment on their applications in physics. 

The case of sums of i.i.d. random variables is clearly the simplest one. In this 
case, there is only one single free distribution in the problem: 

TV 

Jn{xi,...,xn) ^'^p{xi), (12) 
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and it is possib le to establish the following standard version of the Central Limit 
Theorem.EHH 

Theorem 1. Let {xi\i=i,,,,^M be a sequence of N random variables, independent 
and identically distributed, with a finite mean value m, and a finite variance a. Let 
us define y^ = X]i=i ^ij ^N = Nm, and b^ = (jVN . Then the random variable 

zjv = 1 . (13) 

On 

converges in law when N ^ oo to the normal distribution A/o.i- 

The normal distribution A/o.i is the Gaussian distribution with zero mean and unit 
variance 

AAo,i(z) = -i=e-^V^ (14) 

\/ Zn 

Accordingly, one sees that three essential hypotheses are needed in order to 
apply the Central Limit Theorem (at least in its standard form): 

• the variables Xi are independent. 

• the variables Xi are identically distributed. 

• the second moment of Xi is finite (the finiteness of the mean value and of 
the variance then follows). 

When at least one of these conditions is not fulfilled, the standard form of the 
Central Limit Theorem is no longer valid. We see that given the fact that the vari- 
ables are i.i.d., this theorem applies to a large number of probability distributions, 
as the only requirement is the existence (i.e., finiteness) of the second moment. In 
other words one could say that the basin of attraction of the normal distribution is 
'large'. 

It is possible to extend slightly the previous theorem to include some distribu- 
tions without seco nd m oment. The CLT for i.i.d. random variables in its general 
form is given below .1^ 

Theorem 2. Let {xi}i^i,,N be a sequence of N random variables, independent 
and identically distributed according to the probability distribution p(x) . Then p{x) 
belongs to the attraction basin of the normal law if and only if 

limX^ /l-l>^ '\ =0. (15) 

x^oc J^^^^^dx x^p{x) 

As an illustration of this extension, let us consider the case of a power-law 
probability density p{x): 

p{x)^^&{x~xo), (xo>0). (16) 
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If a > 2, the second nioment of the distribution is finite, and Theorem [T]apphes. In 
constrast, if a < 2, the second moment is infinite, and Theorem [T] no longer holds. 
However, for a = 2 we have 

f, I- ^ da; p(x) 1 

^ %^'^'^^, , , = ,, X, , ^0,X^oo. (17) 

J\x\<x^^^ P(^) 21n(X/xo) 

Theorem [2] then shows that this distribution is actually in the attraction basin of 
the Normal law. Moreover similar calculations for a < 2 show that 

x%^i-i>"/"f:\ ^ ^^ . ^^, X -. oo. (18) 

These argument can be extended in a straightforward way to distributions p{x) 
with a power-law tail, p{x) ^ x~^^", a; — > cxd. Therefore probability densities with 
power-law tails with a < 2 do not belong to the attractive basin of the Gaussian 
distribution. 

Before discussing extreme value statistics, as well as several extensions of the 
Central Limit Theorem, we would now like to briefly comment on the usefulness of 
the CLT in physics. 



3.1.2. Examples of applications of the Central Limit Theorem, in physics 

The Central Limit Theorem is one of the cornerstones of statistical physics, giving 
general results about fluctuations of global quantities in systems where correlations 
among the different degrees of freedom can be neglected. As an illustration, let us 
consider a generic system with degrees of freedom {qi}, i = 1, . . . ,N, described by 
a Hamiltonian which can be written as the sum of one-body Hamiltonians: 

N 

1=1 

where Ti.i{qi) only depends on the single variable qi (qi may be a real variable 
or a vector depending on the system considered). At statistical equilibrium in the 
canonical ensemble, the joint distribution of the variables {qi} is given by 



1 / ^ \ ^ 1 

— e^pi^pJ2^,iq,)\^l[- 

1 \ i—1 / i—1 



^({*}) = ^ exp I -/3>>i(g.) 1 = 11 — e-^^^('-). (20) 



The partition function factorizes as a product of N one-body partition functions 
Zi, given by: 

/OO 
dqe-'^'^^^"^ (21) 

Accordingly, the different degrees of freedom are i.i.d. random variables. In many 
cases, the variance of qi is finite, so that the CLT can be applied to the sum S — 
J2i=i li- Once suitably rescaled, this sum thus has a Gaussian statistics in the large 
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N limit, independently of the specific form of the one-body Hamiltonian (as long 
as the variance of qi remains finite). Consider for instance a paramagnet consisting 
of an assembly of N Ising spins Si = ±1, and with a Hamiltonian 

N 
Hpara({sJ) = - ^ /iSz (22) 

1=1 

where h is the external magnetic field. The variance of Si is obviously finite since 
Si is bounded. From the CLT, the total magnetization M = X]i=i ^i i^ distributed 
according to a Gaussian law in the thermodynamic limit N —^ oo. 

Coming back to the general Hamiltonian TC{{qi}), another issue of physical in- 
terest is to determine the fluctuations of the total energy of the system, that is of 
the value of T-C{{qi}). One then needs to make a change of variables, introducing 
Ei = Ti.i{qi), in order to rewrite the total energy as the sum E = X)i=i^j- From 



Eq. pop , the variables Si are also i.i.d. random variables, with distribution 

p{e^) = ^e-^'^\J{e,)\ (23) 

where Jisi) is the Jacobian of the transformation. If the variance of e^ is finite, then 
the CLT can be applied to the total energy E which then follows a Gaussian statis- 
tics. As a simple example, let us consider a classical gas of independent particles. 
In the absence of external field, the Hamiltonian reduces to the kinetic energy: 





WgasdpJ) 


1=1 






(24) 


The distribution 


of kinetic energy per particle ei — 


pf /2m is 


then. 


in D dimensions. 






er\-^^ 


; 




(25) 



where T{t) — Jr. dwi 

finite, so that from the CLT, the total energy follows a Gaussian statistics. 

As we have seen, a large class of observables obey a Gaussian statistics in equi- 
librium systems, provided that the energy of the coupling terms in the Hamiltonian 
can be neglected. When this is not the case, it is often possible at a heuristic level to 
split the system into essentially independent "blocks" that play the same role as the 
independent degrees of freedom in the above description. Hence, the CLT is often 
effectively valid in physical systems, although the strict hypotheses underlying it 
may not be fulfilled. These issues are discussed in more details in Sect. ID 

Note also that many other examples of the application of the CLT in statistical 
physics could be given, where the variables to be summed are not described by a 
Hamiltonian, specifically when considering out-of-equilibrum systems. This is the 
case for instance for the (algebraic) distance travelled by a one-dimensional random 
walk. A possible physical realization is to follow the coordinate along a given axis of 
a Brownian particle in a fluid. If the steps of the walk (i.e., the distance between two 



November 19, 2008 3:55 WSPC/INSTRUCTION FILE review'submitted2 



Global fluctuations in physical systems 11 

successive collisions) are independent random variables with finite second moment, 
then the coordinate of the particle at a given large time is distributed according to 
a Gaussian law. 

3.2. Extreme value statistics of i.i.d. random variables 

3.2.1. Universality classes and asymptotic distributions 

Another example of convergence theorem is given by the mathematical theory 
of extreme value statistics, that is the maximum or minimum value in a set of 
random variables. Following Sect. 12.21 this situation corresponds to the function 
4>{xi, . . . , xn) = max(xi, . . . , xn)- Extreme value statistics has found applicati ons 
in many different fields, like physics of diso rdered systems,'^^! chemical fracture,!^ 
hydrology,'^ seismology,'^ or finance j I ' to quote only some of them. 

For the sake of simplicity we shall restrict ourselves to the case of maximal 
values, but equivalent results are available for minimal values, since a minimum can 
be converted into a maximum by simply changing the sign of the random variable. 
The problem is the following. Let {a;i}i=i...jv be a set of A^ i.i.d. random variables, 
whose common cumulative distribution is F{x) (i.e., the probability that the random 
variable is less than the given value x). From each realization of the set, one can 
define a new random variable 

zat = max(a;i, . . . ,xjv). (26) 

As by definition Xi < zjv for all i, the probability Fj^{z) that the maximum is less 
than a value z (that is, the cumulative distribution of the maximunr) is simply, from 
the i.i.d. property, 

F^''''{z) EE Prob(max(a;i, . . .,xn) < z) 

= Prob(Vi,a;, < z), (27) 



so that one has 



F-^'^^iz) = Fiz)"" . (28) 



A natural question is to try to determine the asymptotic cumulative distribution 
of this maximum value zat (if it exists), with the hope that it does not depend on 
all the details of the original cumulative distribution F. More precisely, one should 
wonder whether it would be possible to find a sequence {ajv, h^^} such that 

lim F^^''{aN + hNx) = H{x), (29) 

iV— *oo 

where _ff is a non-degenerate cumulativ e prob ability function to be determined as 
well. We then have the following results! ^ ^ 

Theorem 3. The asymptotic cumulative distribution H{x) of a set of i.i.d. random 
variables {xi}i^i_,,,^N is necessarily (up to a shift and a dilatation of the variable x) 
of the form Hf^^{x), iJ^^p(a;) or Hg{x) with 
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• Hf_f^{x) — exp (— a;^^) for a; > and for x < (Frechet distribution); 

• Hw^^{x) = exp (— (— a;)^) for a; < and 1 for a; > 1 (Weibull distribution); 

• Hg(x) — exp(— e^^) ( Fisher- Tippett-Gumbel or Gumbel distribution). 

In the previous expressions, /i > is a parameter, called the extreme value index, 
depending on the parent cumulative probability distribution F(x ). Note that a more 
compact parameterization has been proposed by von Mises^^. Up to a dilatation 
and a shift of the variable x, the asymptotic extreme value distributions i7/^^(a:), 
Hw.ii{x) and Hg[x) can be reformulated as H^{x), with a > and b real, where 

H^{x) = exp (-(1 + 7a;)-i/'') , 1 + 7a: > 0. (30) 

The parameter 7 is real and the value 7 == in the right-hand side should be 
interpreted as exp (— e~^), then corresponding to the Gumbel distribution. The case 
7 > corresponds to the Frechet distribution, while 7 < stands for the Weibull 
case. 

Hence the parameter /i in Theorem [3] is related to the parameter 7 in Eq. (|30p 
through /i = 1/7 if 7 > (Frechet distribution) and fx = —l/"f ii "f < Q (Weibull 
distribution). Now we have to specify the attraction basin 'D{Hj) for each of the 
previous distributions. This is the purpose of the following theorem.'^^ 

Theorem 4. Let F{x) and H{x) be non- degenerate cumulative distribution func- 
tions, such that for some constants ajq > and b^ real 

lim F{aN + bNx)'^ ^ H(x). 

Then H is up to a location and scale shift an extreme value distribution H-y, and 
F belongs to the attraction basin T?{H^) of the distribution Hj. We also define 
F{z) = 1 — F[z), which satisfies Ivcuz^oo F{z) — 0. Let ujp = sup{z : F{z) > 0}. 
We then have: 

• F belongs to the attraction basin 'D[Hf^^) = 'D[H^^ii^) if, and only if, 
(jjp = +00 and for all x > 0, 

]im^^x-^, ^>0; (31) 

• F belongs to the attraction basin V^H^^^) — P(iJ^^_i/^) if and only if, 
LUp is finite and for all a; > 0, 

F iujF - 7-) 
lim -^ ifl = a;-'', ^i > Q; (32) 

• F belongs to the attraction basin 'D{Hg) — ^{H-y^o) if, o,rid only if, for 
some finite loq the integral J ^ dz F{z) is finite and for all x > 0, 

lim^^^t-^(^»=e- (33) 

t^oo F{t) 
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with R(t) defined by 



Up 



R{t) = j-i dzF{z), (34) 



Note that it is also customary to speak about classes instead of basins of at- 
traction, in the context of extreme value statistics. For instance, the exponential 
distribution is said to be in the Gumbel class. Let us now try to give an intu- 
itive interpretation of Theorem [H Essentially, it means that when F[z)^ namely 
the probability that the random variable is greater than z, decays like a power law 
at large z, F{z) ^ z^^ with /i > 0, the limit distribution is the Frechet one with 
parameter /i. When z is a bounded variable, that is F[z) = for z > tup, and if 
F{z) '^ {ujf — z)^, z -^ ujp with /i > 0, then the asymptotic distribution is the 
WeibuU one with parameter /i. Finally, if z is unbounded, but if F{z) decays faster 
than any power law when z — > cxd, the asymptotic distribution is the Gumbel one. 
Note however that the theorem also leads to the Gumbel distribution in some cases 
of bounded variables, like for instance F{z) '^ ex:p[—c{ujp — z)^"], z — > ujp, where 
a and c are positive constants. 

As an illustration of how these limit laws can be derived, let us consider the 
simple example of the exponential distribution, for which the cumulative probability 
distribution is F{z) — [1 — exp(— Az)] for z > and F{z) = for z < 0. In this case, 
the cumulative distribution F^'^^{z), i.e., the probability that the largest value in 
the set in N variables drawn from F is smaller than z, reads 

Fj!J--(z) = ^(z)^ - (1 - e-^^) "^ (35) 

On general grounds, one wishes to find a rescaling z = ajy + bifX such that the 
distribution of x converges to a well-defined limit when N goes to infinity. In the 
present case, it is rather easy to see that a correct choice for the rescaling is ojv — 
(\nN)/X and 5^ = 1/A, yielding 

Fr'^iaN + bNx) = h - ^ j ^ exp (e"^) (36) 

when N ^ oo. Hence the distribution F^'^'^{aN + Bnx) readily converges to the 
Gumbel distribution Hg (x) . Clearly, the rigorous derivation of the asymptotic dis- 
tributions in the case of an arbitrary F{z) is much more difficult. Yet, the main 
ideas of the derivation are already sketched in this simple example. 

3.2.2. Asymptotic distributions for the k*^ largest value 

Up to now we only considered the asymptotic distribution of the largest value within 
a set of N i.i.d. random variables, in the limit N — > oo. A further natural question 
would then be to know how the fc**^ largest value in the random set is distributed. 
Note that here k is independent of N, the number of elements in the set; the case 
where k — k{N), sometimes referred to as order statistics, could also be studied,!^ 
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but is outside the scope of the present review. Let us consider the cumulative prob- 
abihty Ffcjv(x) of the fc"^ largest value Xk^N in a set of N i.i.d. random variables. 
Then relation ((28|) can be generalized to obtain^ 

FkM^) = FvohiXk,N < a;) = E ,,.jv:,v -^(^r'-'"[l - ^WF, (37) 

Keeping fixed the index k while iV — > cx), it turns out that the asymptotic for m of 



Fk^N is related to the one of Fk=i_N- This is expressed by the following theorenP^ 

Theorem 5. For a sequence gn and Bn > of real numbers and for a fixed integer 
k > 1, Fk^NioN + bj^x) converges when N —* oo toward a non- degenerate cumulative 
probability Hk{x) if and only if Fi^f^^aN+b^x) converges weakly to a non- degenerate 
cumulative probability H{x), being one of the possible functions given by Theorem\^ 
If Hk{x) exists then it is related to H{x) through 



H,{x)=H{x)^^-^\n^^^j . (38) 

In terms of probability density functions hk{x) — dH^/dx, the relation between 
the fc"^ largest and the largest value reads 

For instance, for random variables belonging to the Gumbel class, we have H{x) = 
Hg{x) and 

h^^'^ (x) = ^^^ cxp {-kx - e--) . (40) 

In order to compare experimental or numerical data with theoretical predictions, it 
is convenient to make a slightly different choice for the parameters a^ and fo^v, in 
such a way that some specific moments of the distribution are normalized to zero 
or one. This leads us to what we shall call in this paper the "standard forms" of 
the generalized extreme value distributions. Namely, one finds for the generalized 
Gumbel distribution with parameter k 

9k{x) = ^ exp \-k6k{x + Uk) - ke-'-^^+^A , (41) 

T{k) L J 

el^^'ik), yk^^[\nk-^{k)\, 

where ^{x) = ■$- Inr(x) is the digamma function. The generalized Gumbel distri- 
bution is illustrated on Fig. [l]for different values of k. Note that one can show that 
when k goes to infinity, the distribution gk (x) converges to the Gaussian distribution 
with zero mea n and unit variance, while it converges to an exponential distribution 
for k -^ O.D 
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Fig. 1. Gumbel distribution gti^) for k = 1 (plain), 3 (dash) and 10 (dot dash). The distributions 
are normalised to have a zero mean and a variance unity. Note the convergence to the Gaussian 
distribution (dot) when k increases. 
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Fig. 2. Frechet distribution /fc,^(a;) for fc = 2, 3 and 4, with /i = 2. Distributions are normalised 
to have a variance unity. 



The generalized Frechet distribution is given for a; > by 



fk,t,ix) = 



M^/ 1 



r{k) x^+'^t' 

A/ - Tikr 



cxp (—XfX 



r(fc)r( A:--) -r(fc-- 



n-M/2 



(42) 



and by fk,fi{x) — for x < 0. The generalized WeibuU distribution reads for x < 



■Wk,t_i{x) 



mA^ 



r(fc) 
A^ - r(fc)-^ 



{-xYk-^e,,^{-K{-xY), 



V{k)V[k+-\ -v(k + - 



p.12 



(43) 
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Fig. 3. WeibuU distribution W]^^^{x) for fc = 1, 3 and 4, with ^ = 2. Distributions arc normalised 
to have a variance unity. 



and Wk^^{x) — for x > 0. Here the Frechet and WeibuU distributions are normal- 
ized such that their variance is normahzed to one. For the Frechet distribution, this 
is possible only when the first moment is finite, that is for k > l//i. The Frechet 
and WeibuU distributions are shown on Fig. [2] and Fig. [3] respectively. 

In the context of extreme value statistics, T{k) = {k—l)l as the parameter k is by 
definition an integer. Still, once written using Gamma functions, these distributions 
can formally be extended to positive real values of fc, although one then looses a 
direct interpretation in terms of extreme value statistics. We shall come back to 
the interpretation of these distributions with noninteger values of k in section [4.3.3l 
To conclude this discussion let us mention that some results exist concerning the 
speed of convergence towards asymptotic extreme value distributions! I I I but 
such results go beyond the scope of the present review. 



3.3. Broad distributions: when extreme values change the statistics 
of sums 

3.3.1. A simple scaling argument on the largest term in the sum 

As mentioned in Section 13.1.11 the standard Central Limit Theorem, associated to 
a Gaussian asymptotic distribution, breaks down as soon as the second moment 
of the individual variables Xi is divergent, i.e., formally infinite (note however the 
slight extension allowed by Theorem [5]). 

Generically, distributions p{x) leading to such a divergence of (xf) are charac- 
terized by a power-law decay at large argument (we assume here for simplicity that 
a;>0) 

Pi^)-^^' ^^oo (a>0). (44) 

In this case, x'^p{x) behaves at large x as l/a;^+"^', so that the g*'' moment (x"^) 
converges only if g < a. Accordingly, the second moment (a;^) is infinite as soon as 
a < 2, and the first moment (x) is infinite if a < 1. 
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This last case is indeed very instructive in order to get an intuitive feeling of the 
somehow surprising behavior of sums of broadly distributed variables. As mentioned 
in the introduction, such sums are often dominated by the largest terms. To see 
qualitatively how this happens, let us estimate the largest value among the set 
{xi}. Introducing F{z) = J^ p{x)dx, one has from Eq. ([28|l 

F'j^''''{z) = Prob(max(a;i, . . . ,xn) < z) = [I - F{z)]^ (45) 

For large N, relevant values of z are also typically large, so that F{z) is small, 
and can be approximated as F{z) w c'z^"^ with c' = c/a. One then obtains the 
asymptotic large N expression: 

F^'^'^iz) w e-^-^(^) w e-"'^^"° . (46) 

Accordingly, the cumulative distribution F^'^^{z) can be written as a function of 
the rescaled variables z/N^^"', which shows that typical values of the maximum of 
the Xi's are of the order of N^^". 

Coming back to the sum X]i=i ^i^ one expects from the laws of large numbers 
that the typical value of the sum is proportional to N at large N, namely J2i=i ^i ~ 
N{x). This should be true at least when (x) is finite. Indeed, if a > 1, the largest 
term in the sum is of the order of A^^/", and becomes negligible with respect to A^ 
at large A^. Hence the largest term does not dominate the sum. In contrast, if a < 1, 
7\ri/a ^ iV at large A^, so that the sum can no longer be proportional to A^ (which 
is consistent with the divergence of (a;)). In this case, the largest term dominates 
the sum, and the latter scales, similarly to the largest term, as N^^". Note however 
that the total contribution of the other terms in the sum does not become negligible 
even when N ^ oo. Only the scaling behavior of the sum with A^ is the same as 
that of the largest terms, but the total contribution of the other terms is itself of 
the order of N^'°'. This explains why, although sums of broadly distributed random 
variables are dominated by extreme values (the largest terms), the distribution of 
such sums does not belong to the classes of asymptotic extreme value distributions. 
Note however that both the Levy-stable distributions (see Sect. 13.3.21 below) and 
the Frechet distribution share a power-law tail with the same exponent. 



3.3.2. Generalized Central Limit Theorem and Levy-stable laws 

In the case when the second moment (xf) is infinite, the standard Central Limit 
Theorem no longer applies (apart from the slight extension given in Theorem[2]). Yet, 
it is still possible to find rescaling parameters ajv and b^ such that the distribution 
of the rescaled random variable z^, 

converges to a limit distribution when N ^' oo, which belongs to a family of dis- 
tributions called Levy-stable laws. These stable distributions depend on two shape 
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parameters a and /3, with < a < 2 and — 1 < /3 < 1, and two scales parameters. 
This means that keeping the shape of the distribution constant, one can always build 
another stable distribution through a translation and dilatation of the variable, as in 
the case of extreme value statistics. Since these scale parameters can be eliminated 
through a redefinition of un and 6jv, we shall not make explicit reference to them 
in the following. Hence, we shall make a standard choice of scale parameters, and 
simply denote the Levy-stable laws as L{z;a,(3). The following generalized central 
limit theorem for sums of broadly distributed variables then holds.'' ^^ '-'" ^ 

Theorem 6. Let {xk}k=i,...,N be a sequenee of i.i.d. random variables with cumu- 
lative probability distribution F(x). We define the random variable y^ ~ X)a;=i ^k- 
Let a and j3 be two real numbers such that < a < 2 and — 1 < /3 < 1. Then 
F{x) belongs to the attraction basin of the Levy distribution L{z;a,(3) defined by its 
characteristic function 



i(fc;a,/3)=exp[-|fc|"(l + i/3fc 


gn(fc)^(fc,a))]. 


(48) 


(p{k,a) — tan— if 


a^l. 


(49) 


(^(fc,a) = -ln|A:| if 

TT 


a=l, 


(50) 


if the following conditions hold: 






F{-x) 1-/3 
x'-^l-F{x) 1 + 13' 




(51) 


hm l-^(^)+^(-^) 
x— foo 1 — F{rx) + F{—rx) 


= r", Vr > 0. 


(52) 



The scale parameters are chosen such that the Fourier transform L{k; a, (3) of 
L(z;a,/3) has the simple form (|15)) . Apart from a few specific values of a and /?, 
no explicit expression for L{z] a, (3) is known in general, but asymptotic expressions 
(for instance, at large |z|) can be derived from the Fourier transform. For a = 2, 
(^(fc,2) = 0, and 

L(/c;2,/3) =exp(-/c2) (53) 

for all values of /?, so that L{z\ 2,(3) is simply a Gaussian distribution. For a < 2, 
L{z; a, (3) depends on /3, which characterizes the asymmetry of the distribution; the 
case (3 = then corresponds to a symmetric limit distribution. Another case where 
the distribution is known explicitly is when a = 1 and /3 = 0, corresponding to the 
Cauchy distribution: 

L(.;i,o)^^^^. (54) 

In practice, the parameters a and (3 can be obtained from the distribution p{x) = 
dF/dx in the following way. If p{x) behaves asymptotically as 

Pix) TCTT-, x^+00, (55) 
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Fig. 4. Examples of Levy distributions, for /3 = and a = 0.95 (plain), a = 1.1 (dash) and 
a = 1.9 (dot dash). 
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Fig. 5. Examples of Levy distributions, for a = 1.1 and /3 = —0.5 (plain), /3 = (dash) and 
/3 = 0.5 (dot dash). Distributions have been centered such that (z) = 0. 



p{x) 



|l+a- 



with < a+. Of- < 2, then from Eqs. ([5T|) and (|52p . a and (3 are given by 

a = min(Q;+, a_), 



X -^ — oo, (56) 

(57) 

if q;+ = «_, (58) 

c+ + c_ 

whereas /3 = 1 if a+ < a- and /3 = —1 if a+ > a_. When /3 = 1, the distribution 
L(z; a, (3) vanishes for z < 0; similarly, it vanishes for z > if /3 = —1. This means 
that for instance a broad negative tail with exponent a_ actually "disappears" 
from the limit distribution if the positive tail is even broader, that is if a+ < a-. 
Note that when L(z;a,P) is nonzero on a given domain (z < or z > 0), its 
corresponding tail has the same exponent as the original distribution p{x) on the 
same domain. For completeness, let us also mention the behavior with N of the 
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rescaling coefficients aj\/ and b^- The coefficient b^ is of the form b^ ~ bgN^^", 
while apf = N{x) + ap if 1 < a < 2 and apf = if < a < 1, where uq and 6o are 
some constants. The case a = I involves logarithmic corrections. 

3.3.3. Example of application: laser cooling of atoms 

Although many systems obey the standard CLT, numerous different examples of 
broad distribution effects in physical systems have been reporte d in the la st decades. 
To give only a few examples, these range fro m glassy dynamics j ^^^ ' anomalous 
diffusion in disordered mediaj ^ ' d| ' ' I ' °l ' ^1 diffusion of spectral lines in disordered 
solids ,"^ ' ^ and random wa lks in solutions of micelles,'^- to laser cooling of atomic 



gases,'^'^ laser trapped ionsj I I fluorescence of single nanocrystals, or chaotic 
transport! ^11 and turbulent flowa^. 

As an illustration, let us consider the case of laser cooling experiments, which 
consist in reducing the dispersion of momenta of atoms through interaction of the 
atoms with photons. One of such cooling protocols is called subrecoil laser cooling, 
and it consists in reducing the momentum spread of the atoms to a value much 

Q Q on 

smaller than the typical momentum hk of the photons. Denoting by q the 

magnitude of the atomic momentum q, the atom-photon interaction process is such 
that the scattering rate of the photon R{q) vanishes for q — 0. In most cases, 
R{q) behaves in the vicinity of g = as a power law of q with an even exponent: 
R{q) ^ q^ , q ^ 0, with /3 = 2, 4, or 6, depending on the specific atom-photon 
interaction process. This means that the average time spent at momentum q between 
two photon scatterings, to be denoted as the lifetime T(g), behaves at small q as a 
diverging power law of q: 

T(9)=r„(^y (59) 

where tq and qm are time and momentum scales respectively (note that q„j <^ hk) . 
After a photon scattering, the atom typically has a momentum q fn hk, so that 
the scattering rate becomes high. Then successive scatterings will rapidly make the 
atomic momentum come back to a value q < qm, where it will stay again for a long 
time. Neglecting the time spent in the region q > q^n, and assunfing that the values 
of the momentum q are uniformly distributed in the £)-dimensional sphere of radius 
qm, the distribution of q reads: 

D-l 
p{q) = D^-^, 0<q<qm. (60) 

Let us now determine the distribution ^(r) of the hfetime r. From the relation 

V'(T)|dr| — p{q)\dq\, one finds 

where c and r^in are parameters that can be expressed as a function of tq, Pm 
and D. The exponent a is given by a = D/p. Note that r is the average time 
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spent at momentum q, and that the actual time Ts spent at momentum q fluctuates 
according to an exponential distribution of mean r. Despite these fluctuations, the 
distribution of Ts averaged over q behaves similarly to ipir) at large r, so that we 
shall not distinguish between the two notions in what follows. 

The time Tjv of the N*'^ scattering can be expressed as T/v = J2i=i '''i- ^^ ^ < 2, 
the fluctuations of Tn at large N are no longer Gaussian, but distributed according 
to the Levy-stable distribution of index a, and asymmetry parameter /3 = 1. If 
a < 1, the typical value of T/v is no longer proportional to N, but rather to A^^/", 
since the formal average value of r is infinite. This has important consequences 
on the behavior of the system. Assuming that a stationary state is reached, the 
probability density Pst(g) to find an atom at momentum q is proportional to the 
density p(g), and to the lifetime r(g): 

Pstiq) - y\p(<z)T(g), (62) 

with (r) = L"" dqp{q)T{q). For a < 1, the distribution Pst{(l) is no longer nor- 
malizable since (r) is infinite, so that no stationary distribution can be reached. 
This means that the dynamical distribution of q becomes more and more peaked 
around q = as time evolves, allowing atoms to reach lower and lower momenta, 
or equivalently, temperatures. 

The same behavior can also be found in other physical contexts, like the ag- 
ing phenomenon in glassy systems. Actually, the kinetic mechanism at play in the 
trap model of aging dynamics is precisely the same as for laser cooling, although 
its physical origin is different. Both models can actually be recast into the same 
formalism once expressed in terms of lifetimes r only.l^iil 

3.4. Convergence to the Gaussian distribution: 'finite-size' effects 

3.4.1. Finite N deviations from the Gaussian distribution 

In the previous section we presented mathematical results concerning the sum of 
random variables. Obviously, these results relie on hypotheses that may or may 
not be satisfied in physical systems. Note also that the observation of Gaussian 
distributions in physical systems does not mean that the CLT applies, that is to say 
that the local variables are i.i.d., and that the second moment is finite: Theorem [T] 
is only an implication, not a equivalence. Theorem [2] is an equivalence between the 
identity p5|) and the Gaussian distribution, only assuming that the variables are 
i.i.d. 

In most physical systems it is hard to know a priori whether these hypotheses 
on the microscopic variables are valid or not. Indeed, one most often studies fluc- 
tuations of macroscopic quantities to gain a better understanding on the statistical 
properties at the microscopic level. In this respect, the observation of non-Gaussian 
fluctuations is much more interesting from the physicist's point of view: from the 
contra-positive of the CLT, either the hypotheses are not true for the physical sys- 
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teni considered, or the number of microscopic random variables is not large enough 
to ensure the convergence towards the limit distribution. Mathematics therefore 
makes observation of non-Gaussian fluctuations much more interesting: it is gener- 
ally the signature of non-trivial physical phenomena in the system, leading either 
to correlations or to broad distributions of the microscopic degrees of freedom. 

However, before drawing such conclusions, one has to check that the number of 
individual random variables is indeed large enough to use a limit theorem. At first 
sight this condition could seem rather easy to fulfill, but things might sometimes 
be more subtle than expected, as we shall illustrate below. Let us imagine that we 
know that the considered quantity is a sum of i.i.d. random variables, each with a 
finite variance. Mathematics and the CLT then tell us that the limit distribution 
of our quantity is a Gaussian distribution. This is a strong result, with a clear-cut 
assumption: the variance is defined or not. The problem is that the CLT does not 
in itself specify how fast the convergence is, so that the number of (random) terms 
needed to actually observe the convergence might be too large to be physically ac- 
cessible. Characterizing the convergence of the distribution of random sums towards 

the nor mal distrib ution is thus an important issue. This is the aim of the following 
theorem.ETESISI] 

Theorem 7. Let {xi}i^i,,N be a set of N random variables, independent and iden- 
tically distributed according to the distribution p{x) , with {x) = m, ((cc — m)^) = a^ , 
< cr < oo, and {\x — m\^) — pa^ < cx3. Then, for any integer N > 0, the 
cumulative distribution function Fj^ (y) of the variable 

2^ = ^(E^'"^'") (63) 



\?— 1 / 

satisfies the following inequality, called the Berry-Esseen inequality: 

ry 



sup 

y 



'^^'^-w.Lj""'^ 



< 4^ (64) 



TV 



where A is an absolute positive constant, independent of N and of the distribution 
p{x). 

Hence we see that the speed of convergence to the normal law is quite slow, like 
\/vN. In addition, the departure from the cumulative normal distribution depends 
on the details of the distribution p{x), through the ratio p of the third centered 
moment to the variance to the power 3/2. If p is large, the convergence to the 
normal law can be so slow that it may not be achieved on physically accessible 
scales, as illustrated on the following example. 

3.4.2. Broad distribution effects in laws with finite but large variance 

The lack of convergence to the normal law on experimentally accessible scales has 
been observed by Da Costa and coworkers in experiments on tunnel junctions.'^ 
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These authors studied the tunnel current measured through metal-oxide junctions, 
in particular when the metal is Cobalt. Their results show a strong heterogeneity of 
the local currents at the film surface. The probability distribution of the local current 
Zioc can be determined experimentally and turns out to be non-Gaussian, and in 
good agreement with a lognormal distribution, as predicted earlier by Bardou!^ 

2' 



P(*i°=) " 17- 7^ ®^P 



1 /, iloc 



(65) 



where (3 and io are two junction-dependent parameters. This lognormal distribution 
can rather easily be under stood in terms of Gaussian fluctuations of the height of 
the junction surface ! '' 

Now one can ask what is the distribution of the total current through the junc- 
tion. Decomposing the area of the junction into small regions, this current is the sum 
of local currents, assumed to be independent: / = X]fc=i *ioc,fc- The total current is 
therefore the sum of i.i.d. random variables, and as the moments of the lognormal 
distribution are finite, the Central Limit Theorem applies: we thus expect Gaussian 
fluctuations for the total current. Experimental results however exhibit strong devi- 
ations from the Gaussian distribution: measured distributions are indeed broad and 
skewed, even if the estimated value of N is rather large. The reason for this observa- 
tion is found in the very slow convergence toward the Gaussian distribution, which 
turns out to be out of reach in this experimental system. To check this point, we 
estimate the value of the parameter p in Theorem [71 which requires to evaluate first 
the moments. From Eq. (|65|) . the moments of the lognormal distribution are given 
by 

{i?oc) = ioe^'"'/' (66) 

Using the inequality {\x — {x)\'^) > {{x — (x))^), one finds 

{x')-3{x){x^)+2{xf 
^- ((x2) - (a;)2)3/2 • ^"'^ 

Together with Eq. (|66p . this last inequality leads to 

e3/3^ _ 3e/3^ + 2 
P^ (e/^-- 1)3/2 (68) 

With the experimental value (3 = 1.84, one obtains the estimate p > 170. Assuming 
that the constant A is of the order of 1 (it can be showrP-^ that A > 1/^/2tt), 
one sees that Theorem [7] does not impose any constraint on the convergence to the 
normal law until N reaches values of the order of p^ ~ 3 x 10^. Let us also note 
that the typical value of the current, that is the locus of the maximal probability, is 

ityp = «oe~^ , (69) 



yielding a ratio 



^^ = e^^' « 160. (70) 

*typ 
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So the average value is much larger than the typical value, which is a standard 
property of broad distributions with finite first moment. The typical value is ex- 
perimentally relevant as it corresponds to the most probable value measured in an 
experiment. 

This example shows that one should keep in mind that observing non-Gaussian 
fluctuations might be the result of a lack of convergence toward the normal distribu- 
tion, due to effective broad distribution effects appearing in finite-size systems. The 
lognormal distribution precisely exhibits such properties if the parameter (3 is large 
enough (typically (3 > 1.5). Similar effects also appear in truncated power-law dis- 
tributions, namely distributions p{x) such that p{x) ex x~^~" for X^in < x < Xmax 
and with an exponential decay for x > Xmax (hence all moments are finite). If 
< a < 2 and X^i^ ^ -^max, one typically has p ~ (Xmax/^^min)"^^, so that the 
convergence to the normal law is generically very slow. 

4. Sums and extreme values of dependent or non-identically 
distributed variables 

4.1. Statistics of random sums 

In this section we shall discuss the case of dependent or non identically distributed 
random variables. These cases are very interesting from the physicist viewpoint, and 
of course turn out to be quite subtle on the mathematical side, apart from some 
simple cases. We shall first explore what happens when the limits of validity of 
Central Limit Theorem are reached. While from a mathematical point of view, the 
hypotheses underlying the CLT are either true or not, the boundaries are actually 
blurred in physics. But after all, it is part of the physicist's savoir-faire to play with 
these blurred boundaries. 



4.1.1. Extension of the CLT to non-identically distributed variables 

Up to now we only considered the case of independent and identically distributed 
random variables. Before including correlations, one can consider the case when the 
variables are still independent, but no longer identically distributed. In other words 
the joint probability of N random variables still factorizes, but the product involves 
different marginal distributions: 

N 

JNixi,...,XN) = Y\_Pii^^)- C^l) 

i=l 

The factorization property makes this case analytically tractable, and some mathe- 
matical results are thus available. It turns out that a slightly generalized form of the 
CLT can be applied, provided that the so-called Lindeberg condition'^"' is fulfilled. 

Theorem 8. Let {xk}k=i,...,N be a sequence of independent random variables with 
finite first and second moments and let Pk{xk) be the probability distribution of Xk- 
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In order that the probability distribution of the normalized sum 

N 



S'jv = 7— V" a^fe - ajv , (72) 

^^ V^i J 

with 

N / N \ 2 

«^ = ^(xfc), b^ ^ iY^iixl) ^ {xkr)] , (73) 

fc=l \k=l / 

converges to the normal law, it is necessary and sufficient that the Lindeberg con- 
dition holds for all e > 0, namely 



^'^^^N-t'j\-\>^»- 



dvv'^Pk {v + (xk)) = 0. (74) 



An intuitive (although not fully correct) interpretation of the Lindeberg condition 
is that the summands become infinitesimal with respect to the sum in the large N 
limit. The Lindeberg condition is straightforwardly satisfied in the case of i.i.d. ran- 
dom variables. In this case, the condition reads 

lim -J / dvv'^p(v + (x)) ^0. (75) 

^— bi J\v\>.b^ 

As bpf goes to infinity when N ^ 00, condition ([75)1 is obviously satisfied. 

Note that the Lindeberg condition implies that the standard deviation b^ of the 
sum (or equivalently the variance bj^) diverges with N. To show this, it is sufficient 
to show that the Lindeberg condition cannot be fulfilled if bN is bounded. In this 
case, since b^ increases with N, it necessarily converges to a finite limit. Hence the 
terms under the sum in Eq. ((74)) asymptotically become independent of N. As all 
terms are strictly positive (at least for small enough s), the sum is larger than a 
positive bound, and the limit in Eq. (j74[) cannot be zero, since the prefactor 1/bj^ 
also converges to a finite limit. 



4.1.2. 1/ f -noise: an example of non-identically distributed variables 

If the Lindeberg condition is not satisfied, one could observe other distributions 
depending on the particular problem: there is no general or universal behavior 
and one has to study each case separately. A simple and explicit example of such 
problems in physics was given by Antal and coworkers.'^ These authors proposed 
a simple model for l//-noise, that we recast here in a slightly different form. In 
this model, one considers a one-dimensional random signal hi parameterized by an 
integer £ = 0, . . . , A^ — 1. This discretized signal may be interpreted either as a time 
signal or as a spatial signal in a one-dimensional system. Decomposing the signal 
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hi using a discrete Fourier transform, the complex Fourier amplitude c„ associated 
with the wavenumber qn — 21:71/ N ^ n = 0, . . . , iV — 1 reads: 

1 ^"' 

The basic assumption of this simple model of l//-noise is that the Fourier co- 
efficients c„, n > 0, are independent complex random variables with Gaussian dis- 
tribution and variance proportional to 1/n: 

P„(c„) = — e-"-l-l^ (77) 

IT 

The value of cq is unimportant to the following, since we shall consider fluctuations 
of hi around the empirical mean h = N^^ X]£=o ^^ ~ co/yN. Hence we define the 
'roughness' of the signal as its empirical variance, namely 

£=0 
This quantity, which fiuctuates from one realization of the signal to another, is 
a natural global observable in this context. From Parseval's theorem, it may be 
conveniently reformulated as a function of the Fourier amplitudes 

JV-l 

SO that we shall also call E^ the integrated power spectrum (or total energy) of the 
signal. 

The integrated power spectrum En can thus be written as a sum of independent, 
but non-identically distributed variables u„ = |c„p. From the Gaussian distribution 
of c„ in the complex plane, it is straightforward to show that the distribution of Un 
is given by 

p„(u„)=nKe-"""" (80) 

As a result, the variance of m„ is equal to K^/n^, so that Var(i?jv) = J2n=i Var(M„) 
converges to a finite limit as A'^ — > 00; accordingly, Lindeberg's condition does not 
hold. 

So as to deal with the infinite N limit, it is convenient to introduce a rescaled 
variable e — {En — {En))/o', where a^ is the infinite N limit of the variance of 
Ejy, namely a^ — J2^=i >^ I'f^ ■ Denoting as ^i^ie) the PDF of e, we introduce the 
associated characteristic function xn{^^ defined as 



Xn{^)= \ de7A^(e)e-^-^ (81) 

Using the independence property of the variables y„, one can express xw('^) &s 
the product of the characteristic functions of «„, n = 1, . . . , iV — 1. In the infinite 
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N limit , xjv(w) converges to the asymptotic characteristic function XooCfj^) given 

^0m 



lUJ \ 
Xc ' 



H=n 1+— -p pi . (82) 



This expression can be transformed using the following relationjl^ valid for any 
complex number z ^ —1, —2, . . ., 

n=l n 

where r(.) is the usual Euler Gamma function, and 7 — 0.577... is the Euler 
constant. Computing the inverse Fourier transform of Xoc('-^)! one finds that the 
limiting distribution V' 00(e) is precisely a Gumbel distribution 

V'oo(^)=5i(^)=exp[-(6x + 7)-e-(''^+^)], ^ = ^' (^4) 

as introduced in Eq. (|4ip . This result is rather striking since there is a priori here 
no relation with extreme values statistics. Understanding whether the appearance 
of the Gumbel distribution in the present context is a coincidence, or if it unveils 
some deep connection betwe en sums of ran dom variables and extreme values is the 
motivation of several studies! ^ ^ ^ ^ We shall discuss this point in details in 
Sect. WM 

Finally, the example of the l//-noise model illustrates how correlated random 
variables (here the physical signal hi) may in some simple cases be converted into 
independent, but non- identically distributed variables (the amplitudes c„) through 
a Fourier transform. Spatial correlations in the system then come from the fact 
that the Fourier modes are extended objects. The key point is that the global 
quantity of interest, namely the integrated power spectrum E can be expressed 
either as a function of the physical signal E = J2ei^i ~ ^Y O'" ^^ ^ function of 
the Fourier amplitudes E = ^^^ |c„P, thanks to Parseval's theorem. Hence the 
statistics of the power spectrum can equivalently be considered as a problem of 
sum of correlated variables or a problem of sum of independent, but non-identically 
distributed random variables. However, this is a rather specific class of problems, 
and in more general cases, correlated variables cannot be converted into independent 
variables. It is thus necessary to develop different approaches to tackle this issue. 



4.1.3. Correlated and identically distributed variables: scaling arguments 

Generically, the case of correlated random variables is very difficult from a math- 
ematical point of view. To the best of our knowledge, there is no general criterion 
as Lindeberg's condition, to ensure the applicability of the CLT for generic cor- 
related variables. However, some rigorous results exist in some specific cases. For 
instance, it is known that the CLT still holds for a particular case of correlation, 
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the martingale differences! ' I t^o l oo l Convergence tlieorems for non-linear function- 
als of st ationary Gaussian sequenc es with power-law correlation have also been 
obtained.ESI i"" | l"^ ' l"l ' "^^^ ' "^^ ' "^^'^ IWe shall come back to this issue in Sect. lJTl 
In addition, propositions have been made recently concerning extensions of the CLT 
to specifi c cla sses of correlated variables using mathematical c oncepts like deformed 
products] lor in relation with Ts a.llis ' non-extensiy e entropy! ' l ^^° l ^"^ lHowever, 
this area is still a matter of debate. EHH^IIISini 

From a less rigorous point of view, different strategies may be used, from sim- 
ple scaling arguments to more involved renormalization group approaches (see 
Sect. 14.1. 5p . Let us start with a simple and intuitive physical argument. Consider- 
ing a large system of linear size L in dimension D, we assume that the microscopic 
degrees of freedom are typically correlated over a length ^ < L. Let us now imagine 
that we are interested in the statistics of a particular global observable. The latter 
can be expressed as a sum of local quantities computed on subsystems with a linear 
size of the order of ^. Then as a first approximation, the quantities computed on 
two different subsystems are statistically independent, so that the global observable 
can be estimated as a sum of iV = (i/^)^ i.i.d. random variables. The main issue 
is now the behavior of the correlation length ^ with the system size L. If L/S, —> oo 
when taking the thermodynamic limit L —> oo, then the number N of independent 
terms in the sum goes to infinity. At a heuristic level, one can apply the central limit 
theorem, leading to a Gaussian distribution for the sum. In contrast, if the corre- 
lation length scales with the system size, that is ^ ~ L, then N remains finite and 
the central limit theorem does not apply. In this case, the distribution obtained in 
the limit L — > cx) is generically not a Gaussian distribution. Note that this heuristic 
argument is qualitatively consistent with the Lindeberg condition: if the effective 
number of degrees of freedom remains finite when N —> oo, one expects that the 
variance of the sum also converges, and Lindeberg's condition does not hold. 

It is possible to make the above scaling argument sharper (though not fully 
rigourous) using thermodynamic concepts as we shall now illustrate in a "magnetic 
language" for definiteness -although nothing is specific to magnetic systems here. 
Consider a spin model with spins {si}, i = 1, . . . , N interacting through a Hamil- 
tonian 7io({si}). In the presence of an external magnetic field h, the Hamiltonian 
becomes Ti.{{si}) = 'HQ{{si}) — /iX]i=i ^i- The partition fonction Z is given by: 

Z = ^e-^««^'». (85) 

Then the successive derivatives of the free energy F{f3,h) = — (l//3)lnZ yield the 
cumulants of the total magnetization M ~ J2i=i ^i'- 

where f{P,h) — F{(3,h)/N is the free energy per spin. Since both f{f3,h) and h 
are intensive quantities, it follows that all the cumulants are proportional to N. In 
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particular, the average value (M) and the variance ct^ of M scale with N. Let us 
thus write the variance as aff — Na^ . To check whether an asymptotic distribution 
exists, one needs to consider the reduced variable z defined as 

z^'^-^'l (87) 

The average value of z vanishes by definition of z, and the cumulants of order 
fc > 2 are actually not affected by the shift by (M) , but only by the rescaling factor 
l/a\N . Accordingly, these cumulants are given by 

Hence the cumulant of order fc > 2 is proportional to A^^"'^/^: the second order 
cumulant remains finite when N goes to infinity, while higher order cumulants vanish 
in this limit. This precisely means that the distribution of z becomes Gaussian in 
the thermodynamic limit. 

Note however that the above result implicitely assumes that all partial deriva- 
tives of f{P,h) with respect to h are finite, i.e., that f{P,h) is regular. Knowing 
whether the free energy per degree of freedom is well-defined and regular in the 
thermodynamic limit is a diff icult mathematical problem, related in particular to 
the theory of large deviations.L!^^ From a physicist viewpoint, it is well-know that 
at a second order critical point where correlations become strong, the second order 
derivative of the free energy with respect to h (namely the susceptibility) diverges, 
and the second order cumulant of M no longer scales with TV. Thus the above ther- 
modynamic argument breaks down, and the asymptotic distribution can be distinct 
from a Gaussian, meaning that the effective number of degrees of freedom remains 
finite. This is due to the fact that the two-point correlation function behaves as a 
power law, and that the only length scale in the problem is the system size (apart 
from the microscopic length scale), so that ^ '^ L. Therefore, from a more general 
point of view, deviations from the Gaussian distribution may be expected when the 
two-point correlation of a random sequence behaves as a power law. 

4.1.4. Taqq's reduction theorem for Gaussian stationary sequences 

General theorems about correlated variables are seemingly difficult to obtain. 
However, interesting limit theorems have been obtained for special classes 
of correl a.ted variables, namely nq n- linear functionals of stationary Gaussian 
sequences! I I I I I I I A Gaussian sequence is characterized by a 
Gaussian joint probability densit y "I (we consider here the case (xi) = for sim- 
plicity) 



N 



T / X VdetR I 1 ^-^ 1 , 
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where i? is a matrix of elements Rij , and R^, are the matrix elements of the inverse 
matrix R^^. If the matrix elements are such that Rij — r{\i — j\) where r{'m) is a 
given function, then the Gaussian sequence is stationaryjj In this case, the marginal 
probability for each random variable is a normal distribution of variance r(0), and 
the two-point correlation function reads {xiXi+m) = r{m). 

In the following, we focus on Gaussian stationary sequences xi, . . . , xn such that 
the correlation function r(m) decays at large distance as a power law, r{m) ~ m^°' 
(note that for a rigorous definition of this power law behavior, the limit N —i- oo 
should be taken before the limit m ^ oo). We then introduce a sequence of variables 
yi,...,yN through 

y,=^j{x,), i^l,...,N, (92) 

where tpi^) is a regular function taking real values, and such that 

dxV'(x)e-^'/2 =0 (93) 

da;V(a;)^e-^'/2 <oo (94) 

Then tp{x) can be expanded over the basis of Hermite polynomials i/*(x), namely 

^{x)=J2c,H*{x). (95) 

i=i 

Hermite polynomials are defined as Hl(x) — x, i?|(a;) — x'^ — 1, and the recursive 
relation H*^^{x) = xH*{x) ~ jH*_^{x) for j > 2. Then il^{x) is said to have Hermite 
rank m* if the first non- vanishin g coefficient in the expansion is Cm» , that is Cj = 
for j < m* and c„. ^ o! 1 17 | 105 | 

The following theoren i^ l ^^ l " I then holds for the sum of the variables yt. 

Theorem 9. Let {a:i}i=i,...,A' be a Gaussian stationary sequence with correlation 
function decaying at large distance as r{m) ^ m^°' . Define the sequence yi = "tpixi) 
with ipix) a real function with Hermite rank m* . If a < 1/m* , the asymptotic 
distribution of the sum Sm = X]i=i 2/* exists, and is non-Gaussian if m* > 1, while 
it is Gaussian for m* = 1. In the opposite case a > 1/m*, the Gaussian distribution 
is recovered. 



■^The definition of a stationary sequence in the general case is actually not obvious, and goes 
as follows. Let xi, . . . ,Xf; denote a set of k random variables. For any vector i(k) of k integers, 
i{k) = (ii, • ■ • ,ifc), where 1 < ii < J2 ■ ■ ■ < *fe < fc, we note 

Fi(fe){xi,...,a;'fc) = Prob{a;',^ < Xs,l<s < k). (90) 

The sequence {x^} is stationary if the probability Fiif.\{x.\, . . . ,X}^) stays invariant if the vector 
i(k) is translated by any vector m = (m, . . . , m), with m any positive integer: 

Fi(k)+m{^l,---,Xk) = Fi^k-){xi,...,Xk). (91) 

Note in particular that i.i.d. random variables form a stationary sequence. 
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The first part of the theorem is known as Taqqu's reduction theorem.LU^ The 
corresponding non-Gaussiai i Uni it distributions are known through their cumulants, 
given by multiple integrals! ^ No te th at an explicit example with m* = 2 and 
a < 1/m* was given by Rosenblatt ! ^ before Theorem |9] was proven. Moreover, 
this theorem shows that, at least for stationary Gaussian sequences, rather strong 
correlations can be included without affecting the limit distribution, which remains 
Gaussian. 

From a more general perspective, it seems that when considering generic classes 
of strongly correlated variables, almost any "reasonable" function could be a partic- 
ular limit function, so that trying to classify them is hardly possible. For instan ce, a 
continuous family of limit functions is obtained in the simple l//"-noise mode l I 
of correlated random signals. Still, from a physicist point of view, the knowledge 
gained from the renormalization group approach in statistical mechanics might sug- 
gest that physically relevant classes of strongly correlated random variables may be 
organized in kinds of universality classes (a notion somehow close to that of basin 
of attraction appearing in convergence theorems). In this rather optimistic picture, 
one could a priori guess what kind of probability distribution is related to a partic- 
ular physical problem, based on general symmetry and dimensionality properties. 
However, even assuming that such a "gallery" of asymptotic distributions could be 
defined, it is presently far from being quantitatively completed. Indeed, most of the 
know n results in the physics literature are obtained through perturbative expan- 
sions,^ ^ ^ and the asymptotic distributions are not known exactly in most cases. 
Moreover, the above gallery of distributions is cont inuo usly expanding, through the 
development of non-equilibrium statistical physics! ^ 

4.1.5. The renormalization group approach 

The renormalization group procedure has had an enormous impact in physics, specif- 
ically in the study of critical phenomena, but also in diverse fields of physics like 
field theory, or the study of disordered systems.^^^^ The main idea of the renormal- 
ization group approach is to coarse-grain step by step the description of the system, 
while conserving the thermodynamic properties. In more mathematical terms, this 
means that the original random variables describing the microscopic degrees of free- 
dom are coarse-grained iteratively into "mesoscopic" effective random variables, and 
that the statistical properties of the sum (for instance the total magnetization in a 
magnetic system) is preserved. This is due to the fact that the transformation con- 
serves the partition function; since the logarithm of the partition function generates 
the magnetization cumulants, it follows that this distribution is conserved through 
the renormalization procedure. 

In the following, we shall briefl y illustrate on a standard solvable example, the 
decimation of the Ising chainj I how a renormalization group approach may be 
used to determine the asymptotic distribution of a sum of correlated variables (in 
the same spirit, an exact renormalization procedure can be performed in the one- 
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dimensional XY-model! I) Note that in practice, examples that can be solved 
exactly through a renormalization group calculation can most often be solved by 
other more direct methods. Yet, various approximation schemes exist in more com- 
plicated situations, and provide valuable insights into the behavior of the system. 

Let us also mention that we are not mostly interested here in the critical point 
of the model, which is a zero-temperature critical point, but rather by the statistics 
of the magnetization away from the critical point, that is at finite temperature. In 
this case, the intuitive scaling argument presented above suggests that since the 
correlation length ^ is finite, the effective number 7V/^ of degrees of freedom [D = 1 
here) diverges in the thermodynamic limit, so that one expects to recover a Gaussian 
distribution. The decimation procedure allows us to obtain this result explicitely, as 
through the renormalization process, the joint distribution converges to a factorized 
distribution (and moments are finite). 

The partition function of the Ising chain (or one-dimensional Ising model) with 
an even number N of sites, and periodic boundary conditions, is given by 

N \ 




-/?^Hm+i(s^,s,+i) , (96) 



where the local Hamiltonian 7ii^i+i(si, Si+i) associated with the link (i,i + 1) is 
given by 

'Hi,i+i(si,Si+i) =: -A'sjS.,+1 - -{si + Si+i) + c. (97) 

Note that the role of Si and s^+i have been symmetrized for later convenience, and 
that a constant term c has been added. This constant term is irrelevant at this stage 
and could be set to zero, but such a term will be generated by the renormalization 
procedure, and it is useful to include it from the beginning. 

The basic idea of the decimation procedure is to perform, in the partition func- 
tion, a partial sum over the spins of -say- odd indices in order to define renormalized 
coupling constants K' and h' . Then summing over the values of the spins with even 
indices yields the partition function Z' of the renormalized model, which is by def- 
inition of the renormalization procedure equal to the initial partition function Z. 
To be more explicit, one can write Z as 

and rewrite the above equality in the following form: 

N/2 

Z = ^ exp I -/3^h;-,+i(s2„S2,+2) I (99) 

{S2j} 
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^N/2. 



where W({s2j}) = '^j=i'^'j j+i{^2j,S2j+2) is the renormahzed Hamihonian, de- 
fined by 

exp[-/3?^'({s2j})]= J2 exp[-/3^?^M+i(s.,s.+i)) ■ (100) 

This last relation is satisfied if, for any given j = I, . . . , N/2, and any given values 
of S2j and S2j+2, 

exp {-l3n'j^j + i{s2j,S2j+2)) 

= Y^ exp (-/3 [n2j,2j+lis2j,S2j + l) + 'H2j + l,2j+2is2j + l, S2J+2)]) -(101) 

S2i+l=±l 

Assuming that 7i' ,_|_i(s2j, S2J+2) takes the form 

h' 

T-{-'j,j+lis2j,S2j+2) = -K's2jS2j+2 - y (s2i + S2J+2) + c', (102) 

one obtains, with the notation s = S2j+i, 

exp ((3K's2jS2j+2 + ^(s2j + S2J+2) - /5c' j (103) 

= ^ exp ( f3Ks2jS + l3Kss2-j+2 + -:r{s2j + S2J+2) + Phs - 2/3( 

Introducing the reduced variables 

u^e-^P^, « = e-2^^ w^e~^P^, (104) 

Eq. (|103p yields the following coupled recursion relations: 

, ^(1 + ?;)^ , v(u-\-v) . it? ,^ ,n, ,,_, , ,_,„^- 

w =7 —-r-^ 7, w' = -^ '-, cj' = ^ l + w)2 u + w 1 + MW . 105 

(m + v)(1 + mw) 1 + w uv^^ ' ^ '' I \ I 

One sees that the evolution of u and u, which correspond to the physical coupling 
constants, is actually decoupled from the evolution of w which encodes the (ap- 
parently useless) constant term in the HamiltonianO When starting from a finite 
temperature so that m > initially, iterations of the renormalization recursion rela- 
tions leads to one of the fixed point uq = Ij ^o > corresponding to a system with 
coupling constant ii' = and arbitrary external field h. Since K — 'd, the spins are 
independent random variables, so that the CLT applies (the second moment is fi- 
nite). As the distribution is the same as that of the original system which included a 
coupling between the spins, one concludes that the magnetization in the correlated 
system also has a Gaussian distribution in the thermodynamic limit. Note however 
that one has to assume that the order of the two limits N ^ 00 and infinite number 



'^Note however that the evolution of tj under renormalization still contains some useful information, 
as one can compute from it the free energy at any temperature. 
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of iterations of the renormalization group can be exchanged, which is not necessarily 
obvious. 

Finally, let us note that the fixed points we have considered here, where the spins 
become independent random variables, is called a "trivial" fixed point. Generally 
speaking, what is more interesting from the physicist's viewpoint is the so-called 
"critical" fixed point, in which the spins become highly correlated. In the Ising chain 
however, it corresponds to u = and w = 1, that is to infinite coupling K, or zero 
temperature, and zero field h. The absence of finite temperature phase transition is 
generic in one-dimensional equilibrium systems with short-range interactions! ^ 

4.2. Statistics of extreme values 

4.2.1. Extreme values of non-identically distributed independent variables 

As in the case of statistics of sums of random variables, losing the i.i.d. property 
leads to much weaker results concerning the limit distributions of extremes. In 
this section, we focus on sequences of independent random variables {xi}, with 
different marginal cumulative probability distributions Fi. This case has deserved 
attention recently due to its practical interest, for example in the study of extreme 
climatic events, w here climate changes lead to a modification of the underlying 
statistics! I I or in application of ideas of extreme value statistics in evolving 
risk insurance.l^ The distribution of the maximum then satisfies 

N 

F^'^'^iz) = Prob(max(xi, ...,xn)<z) = J|i^,(z), (106) 



which is an extension of Eq. (|28p. Note that in practical applications however, 
the marginal distributions are generally unknown, which makes the above equation 
essentially useless for practical purposes. 

If the random variables are strongly non-identical, the asymptotic distribution of 
the maximum could be any probability distribution, as shown on a simple example 
below. Hence, the identification of asymptot ic laws for ex tremes of non-identical 
random variables has to be done case by casej ^ ^ ^ ^ and is beyond the scope 
of the present article. 

Some simple understanding of these issues can be gained using an interesting 
example inspired by Falk and coworkers.!^ It makes use of the following simple 
property: if Fq is a cumulative distribution function, then for any real 7 > 0, 
the function Fq is also a cumulative distribution function. Hence a simple way 
to generate non-identical random variables is to choose a cumulative distribution 
function _Fo a-nd a set of N number 7^ > 0, and to define a sequence of independent 
random variables {xi} with cumulative distribution Fi{z) = Fq(z)'^\ i = l^ . . . , N. 
Relation (|106p then leads to 

Prob(max(a;i,...,a;7v) < z) = Fo(z)^-i^\ (107) 



November 19, 2008 3:55 WSPC/INSTRUCTION FILE review'submitted2 



Global fluctuations in physical systems 35 

It is then clear that the asymptotic law is controled by the behavior ol the sum 
Sn = X)i=i 7i when N —* oo. II Sn converges to a finite hmit 6*00, the asymptotic 
cumulative distribution is simply given by Fq{z) °° , which can be any distribution 
since Fq is arbitrary. 

In contrast, if Sn —^ 00 when iV ^ 00, it is rather easy to show that the standard 
extreme value distributions (namely, the Gumbel, Frechet and WeibuU ones) are 
obtained. The asymptotic distribution is selected among the three possible ones 
according to the function Fq, with the same criteria as those presented in Sect. l3.2TTl 
For the sake of simplicity, we illustrate this result on the example of the Gumbel 
distributions, but the same argument holds for Frechet and WeibuU distributions. 
Defining the function ({z) through Fo{z) = 1 — cxp{—C,{z)), one then has from 
Eq. ([Ml 

F^'^'^iz) = (1- e-^^'A ^" . (108) 

Since we focus on the Gumbel case, we consistently assume that ((z) « Xz" when 
z ^ 00, with A > and v > (although special cases of bounded variables could 
also be considered within the Gumbel class, as mentioned in Sect. l3.2?l]) . One would 
then like to know whether there exists a sequence of reals numbers gn and b^ such 
that FJ^'^^{aN + bpfx) converges to the Gumbel cumulative distribution Hg{x) = 
exp(— e~^). In the large N limit, we write C(ajv + bNx) as 

((aN + bNx)^ XiaN + bNxV = Xa'i.(l + —x] . (109) 

V aw / 

Let us assume that bjq /o-n ^^ when N —^ 00, and self-consistcntly verify this 
assumption afterwards. Expanding to first order in b^ /o-n, we have 

CiaN + bNx) ^ AaJV + Xi^bNa^j^-^x + O (fo^aj^^) . (no) 

We choose un and bN such that 

Xa^ = IuS'at, bNa^j^^ = -—. (HI) 

A// 

Then, qn — (A^^ IuS'at)^/'^ diverges with N, and 

,, „_9 1 1 



^^ (Ai/)2a5V In^AT 



(112) 



when N —>■ 00. One then has 



CiaN + bNx) ^ In Sn+x + o(:^J. (113) 

One also verifies that the choice of ajv and bN is consistent with the assumption 
that bN/aN — *■ when N — > 00, since bN /cln = \/ [Xva'^^). Plugging these results 

N 



F^'-^iuN + bNx) 



l-^exp(-a; + o(-^ 
Sn V \lnSN 



Sjs 



(114) 
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Taking the limit TV — > oo, one finds, as Sjq — > oo, 

F^^^ia^ + h^x) ^ exp (~e-^) (115) 

which is nothing but the cumulative Gumbel distribution. Hence one recovers for 
this specific class of non-identically distributed and independent random variables 
the standard behavior of i.i.d. variables belonging to the Gumbel class. Note however 
that the convergence to the asymptotic distribution may be quite slow, due to the 
logarithmic dependence on Sn- 

4.2.2. Extreme of correlated variables 

The case of extreme value statistics of correlated random variables has deserved at- 
tention in recent years, due to its application to physical situations such as the Ran- 
dom Energy Mode l (REM),^^'^ ^28 129 fluctuating interfaces, ^^^ ^^l 132 133 95 134| 
directed polyn iers! I I ' Burgers turbulence! I j f reely expending gases in 
one-dimensionj^^^jbiological evolution of quasispecie a I or applied statistics and 
climatology! J- 4U| 14 1 1 ^ slightly different issue has also been addressed rece ntly, 
namely the maximum value of a time signal with respect to the initial value! I 
Rigourous mathematical treatments are oiily avai lable in a very few cases (and 
more specifically the Gaussian case3----"i^'- I % but approximate treatments, 
using physi cist' s tools such as replica tricW^^ or functional renormalization group 



approaches • '^■^^ i give some indications on the consequence of correlations. 

Let us first show using an example^ that, as for non-identically distributed vari- 
ables, any probability distribution could be seen as an asymptotic law for extreme 
of correlated variables. To that purpose consider a set of i.i.d. random variables {yi} 
described by an arbitrary distribution, and a random variable u, independent of the 
variables yi, described by a cumulative distribution F{v). Now define a new set of 
random variables Xi through Xi = v + yi for all i. If there exists a sequence of real 
numbers {ajv} such that 

Ve > 0, hm Prob(| max(j/i, . . . ,?/jv) — awl > e) = 0, (116) 

then in the limit iV ^ oo, for any real z: 

Prob(max(a;i, . . . , xn) — ajv < z) — Prob(u + max(2/i, . . . , ypf) — qn < z) 

-> Prob(w < z) = F{z). (117) 

due to Eq. (|116p . This is the case for instance if yi is uniformly distributed over a 
given interval. We then have an extreme of correlated random variables which is 
distributed according to an arbitrary probability distribution. This means that as 
in the case of non-identically distributed random variables, the notion of classes, or 
of basin of attraction, is less useful that in the i.i.d. case. 

Rigorous results can be derived in th e parti cular case of stationary Gaussian 
sequences of correlated random variables! I I as defined in Eq. ([55)) . for which 
{xi) =0 for all i, and the two-point correlation function depends only on |« — j|. 
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namely {xiXi+m) = r{m). Note that the basin of attraction of these theorems is 
therefore quite small compared to the ones of the CLT or even the generalized 
CLT. This is a direct consequence of the complexity induced by the loss of the 
independence between random variables. 

The first kind of results deals with the case of constant correlation, such that 
{xiXij-rn) — fN for all m and i (the value rjv depending on the sample size N only). 
The extr eme distribution depends in this case on the behavior of rjq as a function 

Theorem 10. Let y^ = max(a;i, . . . ,a;Ar) he the maximum of N elements of a 
Gaussian sequence {xk}k=i,...,N with zero mean, unit variance, and constant corre- 
lation r — rN . Let 

ON = ^ --bN{\nlnN + ln4Tr), 6^ = (2 InTV)"^/^ (118) 

On 2 

//. as N — > cx), r^vlnTV converges to a finite value t, then the rescaled variable 
z — {yN — aN)/i>N has a limit distribution. 

• Lf T — 0, the limit distribution of z is the Gumbel distribution as in the 
i.i.d. case. 

• LfT>0, the limit distribution of z is the convolution of a translated Gum- 
bel distribution exp {—{z + r) — e^'-^^'^-'), and a Gaussian distribution with 
zero mean and variance 2r. 



//limTv^oo rjv IniV = cx), then the variable z' ~ {yN — o,N\/^ — '''n)/\/i^n has a limit 
distribution, which is the normal distribution with zero mean and unit variance. 

We see that only in the case of weak enough correlation (first case), the asymp- 
totic distribution remains the same as in the i.i.d. case (because the Gaussian dis- 
tribution of the variables Xi is in the basin of attraction of the Gumbel asymptote) . 
Interestingly, another connection between extreme values and sums seems to appear 
here, since one finds a Gaussian distribution (typical of sums of i.i.d. random vari- 
ables) as asymptotic distribution of extreme values of correlated random variables. 
We shall come back to this issue in Sect. 14.31 

The second kind of results applies to the perhaps more realistic case (at least 
from a physicist point of view) of a correlation r{m) decreasing with the distance 
m. The limit distribution of the maximum of the sequence depends on how fast 
the correlation decays, the transition between the two regimes being once again a 
logarithmic decay: " ^' ^' 

Theorem 11. Let yjq = max(xi, . . . ,a:Ar) he the maximum of N elements of a 
Gaussian sequence {xk\k=i,...,N with zero mean, unit variance, and correlation 
r{m) — (xkXk+m), independent of k. If, as m —> cx), r(77i)ln?Ti converges to a 
finite value t, then the rescaled variable z = (yjv — ON)/bN has a limit distribution 
when N —^ oo, where on and b^ are given in Eq. ill8\) . 
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• If T = 0, the correlation does not affect the limit distribution of the maxi- 
mum, which is the Gumbel distribution as in the i.i.d. case. 

• If T > 0, the asymptotic distribution of the maximum is the convolution of 
a translated Gumbel distribution exp (— (z + t) — e"'^"*"^^), and a normal 
distribution with zero mean and variance It . 

// liiii„i_^oo '"("^) ln?7i = CO and linim^oo ^('7i)(liim)"'^'"^ — 0, then the variable 
z' — [yj^ — aj^y^l — r{N))/ y^r(N) has a limit distribution, which is the normal 
distribution with zero mean and unit variance. 

These results were also derived using functional RG calculations, and applie d to 
the study of the glass transition in the REM with correlated Gaussian potential! ^ 



4.3. Relation between statistics of sums and of extreme values 

4.3.1. Are there extreme values hidden in 1/f-noise? 

Let us come back to the l//-noise problem studied in the previous section, where it 
was found that the PDF of the integrated power spectrum (or total energy) given by 
Eqs. (jTS]) . ((79)) . is the Gumbel distribution Gi, while there is a priori no connection 
with extreme values in this problem. A rather natural idea would be that extreme 
values may be somehow "hidden" in the computation of certain types of random 
sums, in the sense that a few terms may dominate the sum. As discussed before, this 
is the case when considering broad distributions of identically distributed variables - 
although the distribution of the sum is not in this case an extreme value distribution. 
In the present situation, the distributions of the individual variables are not broad 
-the distribution of u„ = |cnp is exponential, as seen in Eq. (f80|) . Still, one might 
imagine that due to the dispersion of the variances of the different variables |c„p, 
some of the variables (the ones with small n's) may dominate the sum, and lead 
to distributions similar to that found in the context of extreme statistics. However, 
attempts to identify such dominant contributions in problems essentially similar to 
the l//-noise, concluded that all terms in the sums are necessary to account for the 
observed probability distributions. To be more specific, such a study was done in 
the context of the XY -model, where contributions of the longest wavelength modes 
were studiedj I I and in the Ising model, wher e the contribution of the largest 
connected cluster of -say- up spins was identified! I In light of these results, it 
seems clear that the relation with extreme value statistics, if it exists, is more subtle, 
and does not come from the dominant contribution of a few terms. 

4.3.2. Mapping an extreme value on a sum 

Actually, the situation becomes clearer when one takes another perspective. Up 
to now, we have been looking for extreme values hidden in problems of sums. Let 
us now take a different point of view: could we instead look for sums hidden in 
extreme values? Although this question might seem a bit strange at first sight, its 
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answer actually contains the explanation of the puzzling relation between statistics 
of extreme values and statistics of some classes of random sums, analogous to the 
l//-noise problem. ^.^^^ 

To see how sums may emerge out of extreme valuesj ^ ^ let us consider a 
set of N i.i.d. random variables a;„ > (1 < n < A'^), drawn from a distribution 
p{x). Let us order these variables by relabelling them into y„ in such a way that 
J/i ^ 2/2 > • • • > Vn- Formally, this means that there exists a permutation a over the 
integers 1, . . . , iV such that z/n = Xa-{n)- By definition, yi = max(a;i, . . . , xn), and 
similarly y^ is the k^^ largest value among the set {a;„}. Once properly rescaled, 
the variable yi necessarily follows one of the three classes of extreme value statistics 
given in Theorem [3l 

Then, one can introduce the differences between the ordered variables, defining 
Vn as 

v„ = y„-y„+i {I <n< N -I), v^^yN- (119) 

It results that the largest value j/i among the a;„'s can be rewritten as 

N 

ma,x{xi,...,XN) = yi = ^Vn. (120) 

71 = 1 

Similarly, the k^^ largest value yk can be expressed as 

iv 
yk = Y.Vn. (121) 

n— A: 

Accordingly, it turns out that extreme values can be quite naturally expressed as 
sums of random variables. Note that up to now, we have only introduced a formal 
procedure to recast an extreme value into a sum. To be more quantitative, we 
need to determine the statistical properties of the variables w„ . To this aim, let us 
introduce the joint distribution ^k,Nivk, ■ ■ ■ , vn) of the variables Vk, ■ ■ ■ , vn- This 
joint distribution is formally defined as: 



^k,Nivk,---,VN) = N\ dyNPivN) dyN^ipiyN-i)--- dyip{yi) 



From this definition, it is straightforward to show tha' 

fc-i 



N-l 

H'^N - j/at) Y\. "^(""'i -yn + yn+i)- (122) 

n—k 

M 



^k,N{vk,---,VN) 



CN \'^'-N / N \ 

i—k / n—k \i—n / 



(fc. 

where the function F{z) is given by 

F{z)= I dyp{y). (124) 
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It is now convenient to perform a shift of indices by introducing u„ = Vn+k-i, 
leading to redefine the distribution $fe^jv(tife, ...jUat) into ^k,N'{ui, ■■■,un'), with 
N' = N — k + I. The expression of ^k,N'{ui, ..., un') is immediately deduced from 
Eq. (fT23)l : 

(N' + k-lV. ( ^' \ ~ ^' /^' \ 

From the very definition of the variables w„, it is clear that the sum X]n=i "«' once 
properly rescaled, converges to one of the asymptotic extreme value distributions 
5fc, /fc,M or Wfc,^ defined in Eqs. (gT]), gl]) and (O. 

It is interesting to note that when describing experimental or numerical data, 
generalized extreme value distrib utions, taking fc as a real and positive fitting param- 
eter, are often considered ! ^^ The question then naturally arises to know whether 
one could give a precise meaning (other than phenomenological fitting functions) 
to such generalized extreme value distributions. 

4.3.3. Generalized extreme value distributions for sums of non-i.i.d. variables 

It turns out that the answer to this question is rather straightforward, given the 
results presented in the previous section. Indeed, from Eq. (|125p . one sees that the 
integer k is now a simple parameter of the distribution, and that the distribution 
^k,N'{ui, ■■■,un') could easily be generalized to non-integer values of k, provided 
that factorials are replaced by Gamma functions. In what follows, we shall denote 
fc as a whenever it is not restricted to integer values. Note that one now needs to 
consider N' as an integer rather than N. In other words, the direct mapping back 
to the problem of extreme values of i.i.d. random variables is no longer possible for 
non-integer k (see however the discuss ion in Sect. l4.3T4l) . Accordingly, it is necessary 



to perform an independent calculation^ to show that the sum of the w,„'s converges 
to the generalized extreme value distributions ga{x), fa,tj.{x) or Wa,fi{x) defined in 
Eq. (|4T|) to (|43p . This calculation has actually been done using a slightly more 
general distribution '^a,N'(ui, ...tUn/) 



*a.Ar'(wi,...,MjV') = — — ^ 

ZiN' 



N' 




(126) 



where ri(i) is an arbitrary positive function of i > 0, and where the normalization 
factor Z]\[i is given by 

In this case, the parameter a > characterizing the asymptotic distribution is given 
by the small t behavior of ri(t), namely 

n{t)r^t''-^, (t^O). (128) 
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r(«) 



^N' 
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(129) 



r(7V' + a)' 

so that one finds for $ajv'(ui, ..., uw) the straightforward generahzation of 
Eq. (|123|) . If 0{i) is only asymptoticaUy a power law for t ^ 0, one docs not 
recover exactly the same form, but this does not affect the asymptotic distribution 
which actually depends on the large N' behavior of Z^', itself dominated by the 
small t behavior of ri(t). 

To sum up, the distribution of the sum X]n=i ^"' with the variables u„ drawn 
from the joint distribution 'i'a,N'{ui, ..., un'), converges to one of the three extreme 
value distributions, according to the asymptotic large z behavior of the function 
p{z) appearing in Eq. (|126p -and which also defines F{z): 

• If p{z) decays at large z faster than any power law, then the asymptotic 
distribution of the sum is the generalized Gumbel distribution ga (x) . 

• If p{z) decays as a power law p{z) ~ z^(i+*') (^ > 0) when z -^ cx), the 
limit distribution is the generalized Frechet distribution fa.fj.{x). 

• If p{z) = for all z > A and decays like p{z) ~ (A - z)^~^ (/x > 0) for 
z -^ A^ , then the limit distribution is the generalized Weibull distribution 

Wa,^{x). 

These results show that a large class of correlated variables, with non-identical 
marginal distributions, lead as far as their sum is concerned to the distributions 
found in extreme value statistics. This fact may explain why these extreme value 
distributions, or at least distributions qualitatively similar, are often found in cor- 
related systems. 

It is also worth mentioning that the distribution ^a,N'{ui, ■■■, ujv) may be sym- 
metrized by summing over all possible permutations a of the integers 1, . . . , TV': 

*a'^7V'(^l'--''"A") = ^ Yl ^a,7V'(u^(l),.-.,'«a(A"))- (130) 

perm (7 

As the sum X]n=i ''^n is invariant under permutation of the terms, the distribution of 
the sum of random variables described by ^^^]^/(ui, ..., ujv') or by '^a.N'iui, ...,MAr') 
is the same. 

To conclude on this point, let us mention that extreme value distributions with 
a real index appeared recently in mathematics, in the context of free probability! I 
This topic is far beyond the scope of the present paper, but it could be interesting 
to see if there is a contact point between the two problems. 

To get a more intuitive feeling about the class of random variables defined by 
the joint probability distribution '^a,N'{ui, ■■■,un'), it is interesting to focus on a 
simple example within the class. Let us consider the case when p{z) is a simple 
exponential distribution, namely 

p(z) = Ae-^^ z>0, (131) 
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leading for F{z) to 

/>oo 

F{z)^ / dyp(y) = e-^^ (132) 



Then the distributfon ^a,N'{ui, ...jUn') reads 

N' 

^a,N'{ui, ...,UN') = n A(n + a - 1) e-^(«+«-i)"". (133) 

n=l 

This is a generalization of the l//-noise problem. Indeed, defining u„ = |cnP in 
the l//-noise model as defined in Eq. ((77|) . one precisely recovers the distribution 
(|133p . with X = K and a = 1. 



4.3.4. Going backward from sums to extreme values 

In the previous sections, we have seen how an extreme value problem can be con- 
verted into a random sum problem, thanks to the mapping relation (|119p . A natural 
question would be to know whether this relation also allows an inverse mapping to 
be performed, that is to go from a problem of sum to a problem of extreme value, 
which could lead for instance to Gaussian distributions for extreme valu e problems, 
as already observed for instance in problems of fiuctuating fronts j I and in ex- 
treme values of strongly correlated Gaussian sequences (see Theorems [TUl and [TT|) . 
Although to our knowledge this possibility has not been explored yet in the litera- 
ture, such an inverse mapping can indeed be performed, and we shall briefly sketch 
the argument in the following. 

Consider a set of N positive random variables {xi}i=i^,,,^N with a joint proba- 
bility distribution ^(a;i, . . . ,xn)- One can then generate a set of variables {zi} such 
that 

N 

z^^Ylxi (134) 

The joint distribution J{zi, . . . , zn) then reads 

. N N / N \ 

J{zi,.. .,zn) = / JJdxi*(a::i,. .. ,a;Ar)]^(5 Zi -^Xj (135) 

•^ i=i i=i \ j=i J 

= *(zi - Z2, Z2 - ^3, • • ■ , ZN^l - ZN, Zm) 

However, the variables {zi\ generated in this way form a increasing sequence, so 
that this distribution in some sense "lacks randomness" . This problem can easily 
be overcome by symmetrizing the distribution, that is by summing over all possible 
permutations a over the integers 1, . . . , A^ (only one term in the sum is nonzero): 

N-l 
Jsym{zi,---,ZN) = ^ J{Za(l),---,Z„i^;^-j)Y['d{Za{i)-Z„i^i+i',) (136) 

perm a i— 1 
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SO that all variables play a symmetric role. As an illustration, we consider two 
simples cases: the case when the variables Xi are i.i.d. random variables, and the 
case when *(xi, . . . , xn) is equal to ^a,7v(a;i, . . . , xn) defined in Eq. (|126p . We start 
with the case of i.i.d. random variables, for which 



N 



^(Xi,.. .,Xn) = Y\_Pi^i) 



(137) 



li p{x) is such that (x^) is finite, the maximum value of the set of random variables 
{zi} drawn from Jsym{zi, ■ ■ ■ , zn) is, by construction, asymptotically distributed ac- 
cording to a Gaussian distribution. This is actually reminiscent of Theorems 1101 and 
[TTl In the specific case when p{x) is a Gaussian distribution, then Jsym(^i, ■ • ■ , zpf) 
defines a Gaussian sequence. It would be interesting to know whether this sequence 
fulfills the hypotheses underlying Theorem [TU] or Theorem [TT] In contrast, if (x^) is 
infinite, the asymptotic distribution of the maximum is a Levy-stable law. 
As for the second case mentioned above, with 



*(a;i,. .. ,xn) = ^a,Nixi, 
defined in Eq. (|126|) . one finds for Jsym{zi, . . . , 



,xn) 



(138) 



J. 



syin 



{zi,...,zn) = ^ 



■ n 



perm a 



■^N 



zn) 

N 



N-1 



^(md) n^^M^)) n®(^- 



(*) 



z. 



<y{i+l)) 



\i=l 




l{p{z,)] J2 ^\FiMl))\^iM^)-M^+l)) (139) 



perm fT 



rN 



where the last step is obtained by relabeling z^r^ in the product Y[i=i Pi^aU))- Then, 
given the constraints imposed by the Heaviside functions, ^^^(i) can be replaced by 
max(zi, . . . , Z]^), which is independent of the permutation a. The remaining sum 
over a of the product of Heaviside functions is simply equal to one, because for a 
given set of values {zi}, only one permutation a satisfies all the constraints. As a 
result, one finds 



N 



<^syin v^l ; 



,ZN) 



-y- Wv{zi) I ^ F(max(zi 



, -ZAt)) 



(140) 



If ri(t) is a constant, Jsym(^i, • ■ • , ^iv) factorizes, and one recovers a set of i.i.d. ran- 
dom variables {zi}. This was expected since a constant i7 corresponds to a = 1 in 
the notations of Sect. 14.3.31 that is to standard extreme value statistics of i.i.d. ran- 
dom variables. The more general case 51 (t) = ^qI"-^^ is also interesting; we focus 
more specifically on the case when p(z) decays faster than any power law when 
z -^ oo, so that the asymptotic distribution of max(zi, . . . , z^r) is the Gumbel 
ga{x). In the large a limit, we know that ga{x) converges to the normal distri- 
bution. It is also expected from Eq. (|140p that Jgymizi, . . . ,zn) depends on {zi} 
mainly through max(zi, . . . , zjv). Going beyond Eq. (jl40p . one might think that if 



November 19, 2008 3:55 WSPC/INSTRUCTION FILE review'submitted2 



44 Maxime Clusel, Eric Berlin 

Jsym{zi, • ■ ■ , zjv) = Cjv J(max(2:i, . . . , zjv)), where J is an arbitrary function, and 
Cn is a normalization constant, the asymptotic distribution of the maximum should 
exactly be GaussianO 

4.4. Illustrations on one- dimensional physical models 

4.4.1. A stochastic dissipative model 

Given that distributions rather similar to the generalized Gumbel distribution have 
often been report^ in the study of rather dif fereiit physical systems like critical 
magnetic models,'^ tu rbulen t flow experiments) ^^ granular gases,!^ or diverses 
nonequilibrium models j ^^ one could wonder whether some generic physical mech- 
anism is able to generate distributions of the microscopic variables of the type shown 
in Eq. (|126p . Indeed, the examples of turbulent flows and granular gases suggest that 
dissipation may play an important role in the emergence of non-Gaussian statistics 
of the energy fluctuations. At equilibrium, equipartition of energy implies that de- 
grees of freedom with a quadratic energy all have the same statistical properties, so 
that the total energy generically has Gaussian fluctuations. ^.^^.^ 

As a purpose of illustration, we consider a simple stochastic mode l I I on 
a one-dimensional finite lattice, in which energy is injected at one boundary, and 
dissipated in the bulk as well as at the opposite boundary. To be more specific, we 
label as n = 1, . . . , iV the sites of the lattice, and we define on each site n a positive 
energy variable e„. Injection of energy proceeds by adding an amount of energy v 
on site n — 1 with a probability rate /(t^). Energy is transferred from site n to site 
n -I- 1 with a rate </>(i/) (note that transport is fully biased), and energy may also be 
dissipated at site n with a rate A(i/). Note that the energy transferred from site N 
is actually dissipated since there is no site A^ -I- 1. 

A case of particular interest, which allows for a simple analytic solution of the 
model, is when the different transition rates are related in the following wajlj 

Ii,y) ^ e-^'' q^{,^), A^ = (e/'^ - 1) 0^. (141) 

The parameters (3 and A respectively characterize the intensity of the energy injec- 
tion and of the energy dissipation with respect to the energy transfer within the 
system. From the master equation describing the evolution of the system] I one 
can show that the stationary joint distribution Vstii^n}) can be expressed as 

N 
Vst {{Sn}) = n (^" + /5) 6"^^"+''^"" • (142) 

Clearly, this is the same distributions as "^ a,N'{uiT . ■ ,um') given by Eq. (|133p 
provided that one identifies e„ with u„, and (3 with (a — 1)A. Hence, it turns out 



°This property can be verified explicitely in the specific case when j{m) = e~^^ . In this case, 
the distribution of the maximum is a Gamma distribution of index N , known to converge to a 
Gaussian distribution when N ^ oo, upon a correct rescaling. 
'Note however that more general cases have also been considered.L 
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that the fluctuations of the total energy £^jv = J2n=i ^n are distributed -again up 
to a proper rescahng- according to the generahzed Gumbel distribution ga{x) in 
the hmit N ^ oo. The shape parameter a is related to the physical parameters of 
the model through: 

a = l + Y- (143) 

A 

This relation emphasizes the role of the dissipation in the statistics of energy fluc- 
tuations, since when the dissipation is very small, that is when A -^ 0, the shape 
parameter a of the Gumbel distribution goes to infinity, meaning that the distribu- 
tion converges to a Gaussian law. 

It is interesting to note that another physical interpretation may be given to the 
parameter a. To see this, we consider the lattice as defined in Fourier space, and 
we map the sites n of the lattice described above onto wavenumbers q„ = 2TTn/L, 
where L is the system size (in real space). In the spirit of the l//-noise problem, one 
can also interpret the energy e„ as the squared Fourier amplitude |c„p associated 
to the wavenumber g„. One then has 

(|c„P)=(^ +/?)". (144) 

On the other hand, the power spectrum (|c„p) is the Fourier transform of the spatial 
correlation function of the system. Denoting as ^ the correlation length, one can 
rewrite Eq. (|144p in the form 

(|cnP) = ^7TT. (145) 

with A = 271 /{XL) and 

This last result is particularly interesting. First, it shows that the correlation length 
of the system is indeed proportional to the system size L, as expected from the 
breaking of the central limit theorem. Besides, it turns out that the ratio £,/L 
of the correlation length to the system size is directly related to the ratio A//3 
comparing dissipation and injection, as well as to the shape parameter a of the 
Gumbel distribution. Interestingly, in the l//-noise problem, corresponding to the 
limit a — > 1, the ratio ^/ L becomes infinite, which may be interpreted as a highly 
correlated limit. The model described here may then be considered as a model of 
"truncated l//-noise". 

4.4.2. A confined gas of classical independent particles 

In the last section, we gave an example of physical model leading to the joint dis- 
tribution (|126p . However, this example deals with the specific case of independent 
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(though non-identicaUy distributed) variables. The joint distribution (|126p is ac- 
tuaUy much more general, and it would be interesting to have a simple physical 
example of correlated random variables following the distribution (|126p in its gen- 
eral form. 

To this purpose, we consider the simple example of a one-dimensional gas of 
cla ssical independent p articles. Models of one-dimensional gases, like the Jepsen 
gasj I I I I ' have proved very useful in the development of statistical 
physics, due to their simplicity and to the possibility to test explicitely some sta- 
tistical approaches. Here we consider a situation where the gas, subjected to an 
external potential, is confined within a container closed by a piston (see Fig. [6|), 
and is at thermal equilibrium with a heat reservoir.LL^ The positions of the TV 
particles are denoted as zi, . . . , z^r > 0, and the piston is situated at Zp, with the 
obvious constraint that Zi < Zp for i = I, . . . , N. Particles are subjected to an ex- 
ternal potential U{z), such that U{z) -^ oo when z — > cx). In addition, the piston 
is subjected to a potential Up{zp), that may be of the same type as that acting 
on the particles, or of a different nature. For instance, the potential Up{zp) may 
describe a constant force fp — —\fp\ exerted by an external operator, in which case 
Up{zp) = \fp\xp, or a harmonic potential Up{zp) = ^kzp created by spring. 



Piston 



9 



Particle 




Fig. 6. Simple example: one-dimensional gas of classical independent particles. 



At equilibrium at temperature T, the probability distribution of the position of 
the particles and the piston reads 



Pn{zi,...,zn,Zp) 



1 



N 



-0Uj,{zp) 



ne-'^^(^''e(zp-z,), 



(147) 



with (3 = l/ksT. Similarly to what was done to map extreme values on sum in 
Eq. (|119p . one can define the intervals hi between the ordered positions of the 
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particles, in such a way that the position of the piston, that is, the volume of the 
system, can be expressed as 

Af+l 

Zp=J2 ^r (148) 

Eq. (|147p is then very similar to the distribution (jl26p . up to a change of N into 
N -\- 1. The identification is then made by choosing the function p{z) as 

p(^) = Ae-^^("), (149) 

(A is a constant such that p{z) is normalized to one) and by imposing that the 
function ^{y) satisfies 

n[^(zp)]p(zp) = e-'5^-(^-). (150) 

A solution to this last equation can be found by noticing that F{zp) is a monotonous 
function of Zp, and is thus invertible. We denote as F^^{y) the inverse function of 
F(zp). Then the function Q{y) can be defined from 

niy) = lexp [f]U{F-\y)) - (3UpiF-\y))] , (151) 

a relation equivalent to Eq. (|150p . In the simple case when U{z) = Uqz" and 
Up{zp) = Uq Zp, with C/q, t/g, a > 0, the function fl{y) behaves as a power law in 
the limit y ^ 0, 

niy)^y^-\ a^^, (152) 



up to logarithmic corrections ! I Then the distribution of the volume Zp is, in the 
limit A^ — > oo, a generalized Gumbel distribution of parameter a. More general 
situations can also be considered, leading either to the Gaussian dis tribu tion, to 
the exponential distribution or to the Frechet or WeibuU distributions! ^ 

4.5. An analog of the Gumbel distribution in two dimensions: the 
'BHP' distribution 

4.5.1. Extending the 1/f-noise model to higher dimensions 

In the previous sections, we saw how, motivated by the study of the l//-noise model, 
extreme values statistics could be reformulated as a problem of sums, allowing 
interesting extensions to generalized extreme value distributions, as presented in 
Sect. 14. 3!^ In particular, the class of random variables defined by Eq. (|126p turns out 
to be useful in the study of some simple one-dimensional models, as seen in Sect. 14.41 
In view of considering more realistic models, it is natural to try to generalize the 
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l//-noise model to higher space dimensions^ To this aim, one can consider D- 
dimensional sums of the form 

E^Y. G-'{q)ege_g, (153) 

where "Zd is the Z?-dimcnsional Brillouin zone, i.e., the set of _D-dimensional vectors 
q = {2TTni/L,- ■ ■ ,2TTnD/L), where < n^ < L ~ 1 {k — 1,...,D), and 9q is 
the Fourier coefficient associated with mode q. Note that for convenience, we use 
here notations coming from field theory, but one could equally use the summation 
on integers as done in Sect. (|4.1.2p . For simplicity, we search for a model that 
fulfills rotational invariance (at least at large scale), so that we choose the inverse 
propagator ^^^(q) to depend only on the modulus g = |q|. An essential property of 
the l//-noise model is the logarithmic behavior of the average sum with the number 
N of terms. One thus wishes to choose the most simple function G~^{q) that fulfills 
this property in arbitrary dimension. In the continuous limit, one has 

{El)~ I dqpiq)giq) (154) 

■/27r/L 

with N — L^ , and where p{q) is the coarse-grained density of modes on the recipro- 
cal lattice. One has p{q) ~ q^^^, so that E^ ~ InL on condition that G{q) ~ q^^- 
We thus simply take G^^{q) = q^ ■ 

The two-dimensional case deserved a lot of attention in the recent literature, 
since the propagator Q{q) — q~^ is very frequent in physical syst ems. It describes 
for instance the magnetization of the two-dimensional XY-mode l ^ in the low- 
temperature regime, as well as the ro ughness of fiuctuating interfaces in the two- 
dimensional Edwards- Wilkinson model ! ^^ ^ The corresponding distribution is 

often called "BHP distribution" after Bramwell, Holdsworth and Pinton who first 

37 
reported it in turbulent flows and in the XY-model. 

In the context of the two-dimensional XY-model, the global quantity of interest is 

the total magnetization M of the sample of N spins, defined in terms of independent 

Fourier coefficients 9q by 



It E ^-^^--J- (155) 



Bramwell and co-workers obtained an expression for the Fourier transform of the 
BHP di stribution ,!^ under some hypotheses that have been questioned and clarified 
later on! " I "'-' I Although the BHP distribution is not of Gumbel type, it has been 
shown that it could be quite well approximated (for instance by matching the first 
four cumulants) by a generalized Gumbel distribution with parameter a ~ 1.57, in 



^Note that inte resting one-dimensional generalizations, known as l//'*-noisc, have also been 
studied.HSmSl] 
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the experimentally or numerically accessible windo w ^^ (see Fig. [7]). This simi- 
larity with the (gener alize d) Gumbel distribution is confirmed by the asymptotic 
expressions of the tails!^ 



-PBHp(a;) 
^BHp(a;) 



□ ^la; 



exp(— 776 



X2X 



X2X) 



(156) 
(157) 



with some positive constants t], Ai and A2. Note that because of the minus sign in 
the definition of the magnetization ()155p . the asymmetry is opposed to the one of the 
standard extreme value distributions presented in section (|3.2.ip . These asymptotic 
relations are interesting, since they show at the same time that the tails are qualita- 
tively similar to that of the Gumbel distribution, but that there exists quantitative 
difference, like the algebraic prefactor in the positive tail. 




(b) Semi-logarithmic scale 



Fig. 7. Comparison between standard Gumbel distribution (a = 1, dash), generalized Gumbel 
distribution with a = 1.57 (dot dash), and BHP distribution (plain). 



4.5.2. BHP distribution as the leading contribution in the moderately 
correlated regime 

It has been early noticed that the BHP distribution also appears, within exper- 
imental errors, in a context completely different from magnetic systems, nam ely 
the fluctuations of injected power in a three-dimensional driven turbulent flow.'^^-'-' 
This amazing observation triggered many other studies where the BHP distribution 
has been found to be a goo d approxiinate des cription of experimentally or numeri- 
cally measured distributions! I II II ^The p ossible reasons for th is apparent 
ubiquity have been quite debated in the last decade] I I I II particularly 
due to a tentative link with extreme events. 

We now give a ge neric argument, inspired by the study of the two-dimensional 
Ising model] " I "" I in order to clarify this issue. Consider a system fluctuating 
around a local minimum of potential energy; this could be a system at equilibrium, 
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or a particular case of out-of-equilibrium system. The distribution of the fluctuations 
of the global quantity is described by a (pseudo-)Hamiltonian, or 'action' in a field- 
theoretic language, which could be quite complex. In order to obtain a Gaussian 
effective action, the simplest idea is to perform a perturbative expansion. From the 
probability viewpoint, this is similar to group the random variables by blocks of 
linear size of the order of the correlation length. It is however well-known from the 
theory of critical phenomena that the resulting effective action does not describe 
correctly all the system p rope rties. The breakdown of this expansion is quantified 
by the Ginzburg criterion.L!^^ We define the ratio 

/5(^) C(r)dr 

where S, is the correlation length, C{r) the two-point correlation fmiction and m{r) 
the local order parameter (to be interpreted as the local magnetization in the Ising 
model); the integrals are over a sphere of radius ^ in I? dimen sions . A mean-field 
theory captures the physical behavior of the system if R^ <^ l! "' I In the present 
context, we do not look for an effective description of all the properties of the system 
at the scale of the correlation length, but we only want to describe the behavior of 
its large scale fluctuations. A natural extension of the previous criterion i n ord er to 
check the validity of a perturbative approach at the integral scale is the n "" I 

Rl ^ ''^'^ , ,,, , -A(\] «1, (159) 

where A is an order unity constant. This criterion is actually much less restrictive 
than the original criterion. This means that the large scale behavior of a system 
could be studied by a perturbative expansion much more easily than the small scale 
behavior. In particular, for the two-dimensional Ising model, it is possible to perf orm 
such an expansion while the (finite size) system is already in the critical regionM^^ 
starting in the low temperature regime, we approach the critical point from below, 
so that f increases. We then increase the system size while keeping the ratio ^/L 
constant, but much less than 1. Doing so the correlation length diverges, confirming 
the critical behavior of the system considered. But it diverges with a small amplitude 
which allows the large scale behavior to be captured by a perturbation theory. The 
action can then be decomposed in the following way: 

5-i^a-^(g,(/'o)V-q+'5o(0o), (160) 

where 

g-\qAo)^c^o+ql + ql, (161) 

and 00 is the pos ition of the energy minimum. A detailed study of those 
fluctuations! "6 | 1po | shows that the flrst part of the action leads to fluctuations 
similar to that of the two-dimensional XY-model at low temperature, with a cut-off 
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(a) Linear scale 



(b) Semi-logarithmic scale 



Fig. 8. Distributions obtained for the Gaussian model using propagator II161I I. for different masses: 
<^0 = ('BHP' distribution, plain), tpo = 0.1 (dot), (/>o = 1 (dash), </<o = 2 (dot dash) and </<o = 5 
(long dash). Note the convergence towards the normal distribution when the masse increases. 



related to ^o , playing a role similar to that of a magnetic field in the XY-model! I 
This contribution does not depend on the universality class (in the sense of critical 
phenomena) of the system, and therefore could be seen as " super- universal" ; it de- 
pends only on the space dimension D. If (/>o can be varied by adjusting the external 
control parameters (like temperature or magnetic field), reducing its value close to 
zero should make the distribution closer to the BHP one, as illustrated on Fig. [8l 
However, doing so, the effect of higher order terms (in particular quartic terms) in 
the action may become significant, leading to corrections with respect to the BHP 
distribution. These corrections correspond to the fact that the system could leave 
the local minima and explore the whole phase space; they are char acter istic of the 
system considered, and can be formally computed using instantons! ^ 

The contribution of these corrections in the probability distribution is actually 
rather easy to identify. By construction the large negative fluctuations induced by 
G~^{q,4'o) are closer to the Gaussian distribution than to the BHP distribution, 
given by G~^iq, 0). In particular the quasi-exponential tail should be below the one 
of the BHP distribution, as seen on Fig. [9l which compares numerical simulations 
of the two-dimensional Ising model and of the two-dimensional Gaussian model. 
At low temperature. Fig. [91(a), the two distributions overlap, showing that non- 
linear contributions are negligible. While we approach the critical point from below. 
Fig. [91(b), the weight of such corrections increases, so that it becomes impossible 
to neglect them to describe the large fluctuations. These observations lead to a 
practical criterion to say whether the large scale behavior of the system could be 
studied through a perturbative approach. 

Altogether, the above approach -which can be generalized in a straightforward 
way to Z?-dimensional systems- yields a rationale for the frequent appearance of 
distributions close to the BHP distribution in two-dimensional systems. This comes 
from the rather general relevance of Gaussian models with propagator G~^{q, 0) in 
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10'' 



10' 





(a) Low temperature behavior 



(b) Critieal region 



Fig. 9. (a) Ising model at T = 1.7 J for N = 64^ (cross), and Gaussian model with mass </>o = 
0.3 (plain), (b) Ising model at T = 2.13J for TV = 64^ (eross), and BHP distribution (plain), 
corresponding to a 2D gaussian model with zero mass. 



the description of fluctuations around a local minimum of energy. Note however that, 
quite importantly, this does not explain the observation of the BHP distribution in 
turbulent flows: assuming that a Gaussian action could be a reasonable description 
of such a flow (which would remain to be justified), one would expect a three- 
dimensional Gaussian model to be relevant in this case. This might suggest that 
a dimensional reduction is at play in out-of-cquilibrium systems. Alternatively, it 
may be possible that a Gaussian action is not a relevant description in this case, 
and that the reason for the appearance of an approximate BHP distribution in 
this context relies on completely different grounds. In any case, understanding the 
statistical behavior of driven systems, and the possible relationships with (critical) 
equilibrium systems, remains one of the challenges of nonequilibrium statistical 
physics. 



5. Conclusion 

In the present review article, we tried to adopt a somehow original perspective by 
presenting essentially on the same footing different types of convergence theorems, 
namely those for sums of random variables and those for extremes values. The 
motivations for this was to highlight the similarities, differences and relationships 
between these two a priori unrelated fields of probability and statistics. As this re- 
view paper is mainly aimed at a physicist readership, we attempted to incorporate 
both the mathematical rigor when stating the theorems, and more intuitive physi- 
cist's approaches when going farther than precise mathematical results would allow 
us to go. We also tried to give many physical examples of applications, in order to 
make contact between formal results and the real world, or at least some simplified 
pictures of the latter. 

Beside recalling the standard mathematical convergence theorems, one of the 
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central points of the present paper is the mapping between extreme values and 
sums of random variables, which precisely allows one to bridge the gap between the 
two fields. Although this mapping is very simple, it has non trivial consequences, 
in that it allows to map the convergence theorems known in one field to the other 
field. In particular, generalized extreme value distributions can be recovered for 
sums of specific classes of non-i.i.d. variables, and Gaussian distributions are found 
for the extreme value of some classes of correlated random variables. Another bridge 
between the two fields is also the dominant effect of the largest terms within sums 
of broadly distributed variables. Still, in this case, the relation is very simple (and 
more direct), and relies on the typical magnitude of the extreme values rather than 
on the specific properties of their fiuctuations. Moreover, the sum does not have 
exactly the same distribution as its largest term, only the scaling properties with 
the number of terms is the same. 

Clearly, statistical physics remains a fertile testing ground for probability con- 
cepts, and both fields benefit from this mutual interaction. In this spirit, let us 
mention a recent example motivated by the physics of disordered systems, and 
more specifically the Random Energy Model! I I In this model, the partition 
function, which is a random variable due to the presence of random disorder, is a 
sum of independent random contributions (the Boltzmann-Gibbs weights associated 
to microscopic configurations). One of the interests of this problem comes from the 
fact that the statistics of each term depends on the total number of terms, both 
being related to the system size. Hence standard convergence theorems cannot be 
applied, and this induces a non-trivial behavior, which is at the origin of the glass 
transition in this model. Recent progresses have been made in this specific fieldj I 
and one may hope that such results will trigger new researches both in mathematics 
and physics. 
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